-- Logs begin at Mon 2022-01-17 08:56:47 UTC, end at Mon 2022-01-17 10:16:57 UTC. -- Jan 17 09:33:19.177731 dv-cinder-824839-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 17 09:33:19.186213 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 17 09:33:19 2022] *** Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: nodename: dv-cinder-824839-2-iscsi Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: machine: x86_64 Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: clock source: unix Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: pcre jit disabled Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: detected number of CPU cores: 4 Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: current working directory: / Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: detected binary path: /usr/bin/uwsgi-core Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: your processes number limit is 47680 Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: your memory page size is 4096 bytes Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: detected max file descriptor number: 2048 Jan 17 09:33:19.188198 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: lock engine: pthread robust mutexes Jan 17 09:33:19.189033 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: thunder lock: enabled Jan 17 09:33:19.189033 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 17 09:33:19.189033 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 17 09:33:19.233376 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: Python main interpreter initialized at 0x55c105f739c0 Jan 17 09:33:19.233376 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: python threads support enabled Jan 17 09:33:19.233376 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: your server socket listen backlog is limited to 100 connections Jan 17 09:33:19.233376 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: your mercy for graceful operations on workers is 90 seconds Jan 17 09:33:19.233718 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: mapped 403077 bytes (393 KB) for 2 cores Jan 17 09:33:19.233794 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: *** Operational MODE: preforking *** Jan 17 09:33:19.234056 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: *** uWSGI is running in multiple interpreter mode *** Jan 17 09:33:19.234056 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: spawned uWSGI master process (pid: 91322) Jan 17 09:33:19.234256 dv-cinder-824839-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 17 09:33:19.235358 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: spawned uWSGI worker 1 (pid: 91335, cores: 1) Jan 17 09:33:19.235358 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: spawned uWSGI worker 2 (pid: 91336, cores: 1) Jan 17 09:33:19.235358 dv-cinder-824839-2-iscsi devstack@keystone.service[91322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 17 09:33:24.917143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 09:33:24.917143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: from cryptography.utils import int_from_bytes Jan 17 09:33:24.918134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 09:33:24.918134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: from cryptography.utils import int_from_bytes Jan 17 09:33:24.921855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 09:33:24.921855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: from cryptography.utils import int_from_bytes Jan 17 09:33:24.922335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 09:33:24.922335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: from cryptography.utils import int_from_bytes Jan 17 09:33:24.974408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 09:33:24.974582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 09:33:24.974794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] command line args: [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 09:33:24.974909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 09:33:24.974996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 09:33:24.975074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 09:33:24.975176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] command line args: [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 09:33:24.975340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ================================================================================ {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 09:33:24.975450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 09:33:24.975536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] admin_token = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.975633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ================================================================================ {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 09:33:24.975711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] config_dir = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.975869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.975956 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] admin_token = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.976033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] config_source = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.976141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] config_dir = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.976480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] debug = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.976783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.976916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] config_source = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] debug = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] list_limit = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.978967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] log_config_append = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] list_limit = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] log_config_append = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] log_dir = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] log_file = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] log_dir = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.979943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] log_file = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.980929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.981610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.981832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.981919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982811 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.982936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.983706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] publish_errors = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] publish_errors = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.984946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.985112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.985316 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.985514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.985900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] standard_threads = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.986124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.986266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.986470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] standard_threads = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.986585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.986708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.986929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] use_journal = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] use_json = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] use_journal = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] use_stderr = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] use_json = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] use_syslog = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] use_stderr = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] use_syslog = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.987835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 09:33:24.987892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.987949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.988926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.989967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.990830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.997674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.997825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.998953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:24.999983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000071 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.000879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.001979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.002992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.003953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.004937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.005967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.006943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007047 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.007950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] auth.external = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.008893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.009055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.009147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.009292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] auth.password = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] auth.token = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.011923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] credential.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.012969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] auth.external = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013411 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] auth.password = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] auth.token = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.013957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.014840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] credential.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.015991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016896 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.016958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.017018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.017138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.017349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.017486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.017627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.017777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.017916 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.018999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.019989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.020961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.021948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022348 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.022961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.023878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.024982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.025966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.026075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.026217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.026493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.026570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.026803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.026888 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.027775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.028477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.028566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.028790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.028994 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.029909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.030999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.037413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.037555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.037684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.037787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.037869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.037943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.038928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.039952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.040988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041466 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.041958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042030 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042396 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.042950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.043579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044725 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.044942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] role.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] role.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.045982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046429 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.046848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] role.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.047967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] role.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.048962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.049927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.050984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.051958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.052922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.053867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.054898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.connection = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.055971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.056926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.057956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.058947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059442 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.059917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.connection = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.060066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.060148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.060222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 09:33:25.060349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.060592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.060839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.061080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.061322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.061562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.061802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.062085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.062329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.062579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.062850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.063107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.063348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.063598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.063834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.064283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.064423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 09:33:25.064536 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 09:33:25.089708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.089933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.090159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.093958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.100468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.100468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.103180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.109040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.133628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.137734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.137823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.137823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.195686 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.195863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.250018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.250222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.255450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.255687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.325855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.326075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.326282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.326501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.326718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.326957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.336080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.336538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.336758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.337078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.337410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.337734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.362244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.362477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.362705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.362956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.363177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.363382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.363593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.365149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.365488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.365831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.366181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.366532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.366912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.367178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.376353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.381138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.389613 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.389847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.390072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.390292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.390508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.398812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.398812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.399990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.400229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.400456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.400680 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.400901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.401120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.401337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 17 09:33:25.416335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.416541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 17 09:33:25.416800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.416884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.417012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 17 09:33:25.417110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 17 09:33:25.417307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.417388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.417532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 17 09:33:25.417613 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.417802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.417893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.418053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.418133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.418311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.418569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.428762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.429033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.429299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.429517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.429601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.429800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.430077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.431470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.437919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.438399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.441133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.442226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.442413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.442501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.442577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.442652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.442770 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.442851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.442925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.442999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.443926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.444008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.444196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.444463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.472972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.473366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.474481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.474779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.474989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.475269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.479852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.480126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.480403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.480530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.487873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.487873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.488016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.488016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.488354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.488635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.492177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.492457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.492757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.493035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.493226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.493312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.493515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.493598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.493796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.493879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.494074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.494157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.494347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.494620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.494917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.495247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.512185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.512979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.513936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.514215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.517407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.518827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.520939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.521224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.522387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.525621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.526110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.527636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.530328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.531677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.533878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.534170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.534705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.535010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.535282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.535561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.535656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.535859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.536145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.536426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.536703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.537008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.554262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.554541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.554899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.555163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.555575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.555955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.556227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.556493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.562870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.564355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.564527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.564797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.566022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.566294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.567778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.568080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.568367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.568653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.568927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.569297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.569582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.569882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.570166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.570450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.582440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.582712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.583014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.583291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.583569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.583843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.584070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.584167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.584347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.584625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.584905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.585185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.585461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.585788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.602048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.604141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.605240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.608444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.609291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.609993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.611594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.611871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.612156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.612606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.614199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.615839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.616113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.616401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.619428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.621004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.623707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.624149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.624437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.624732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.625004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.625272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.628503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.634581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.634581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.634581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.634858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.634858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.634858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.638920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.639221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.639514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.643774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.644059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.644343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.644615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.644884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.645160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.645440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.645732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.646073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.646337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.646617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.646905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.647274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.647370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 17 09:33:25.647530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.647620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.647893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.648164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.648432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.648712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.648990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.649264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.649552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.649823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.650542 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.650542 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.650825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.650968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 17 09:33:25.686287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c105f739c0 pid: 91335 (default app) Jan 17 09:33:25.689890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e044-4d77-4336-98e0-895095485901 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:25.690203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e044-4d77-4336-98e0-895095485901 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:25.690481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e044-4d77-4336-98e0-895095485901 None None] PATH_INFO: `/v3` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:25.693056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c105f739c0 pid: 91336 (default app) Jan 17 09:33:25.694626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 791 bytes} [Mon Jan 17 09:33:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:35.398656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc53a6-3b42-4e3b-b7cf-d80544a8b4cc None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:35.399183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc53a6-3b42-4e3b-b7cf-d80544a8b4cc None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:35.399277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc53a6-3b42-4e3b-b7cf-d80544a8b4cc None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:35.404180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1/2] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:33:35.410123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:35.410525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:35.410669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:35.538712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG oslo_db.sqlalchemy.engines [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 09:33:35.728716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG passlib.handlers.bcrypt [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91335) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 17 09:33:35.729122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG passlib.handlers.bcrypt [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91335) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 17 09:33:35.784768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:35.786375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:35.912967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 2/3] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:33:36.087786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc53a6-3b42-4e3b-b7cf-d80544a8b4cc None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:36.217257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG oslo_db.sqlalchemy.engines [None req-69fc53a6-3b42-4e3b-b7cf-d80544a8b4cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 09:33:36.345941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc53a6-3b42-4e3b-b7cf-d80544a8b4cc None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:36.350148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13ecd-2a42-4e99-9927-df4b87e3075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:36.350838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13ecd-2a42-4e99-9927-df4b87e3075a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:36.351125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13ecd-2a42-4e99-9927-df4b87e3075a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:36.351401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13ecd-2a42-4e99-9927-df4b87e3075a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:36.360006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13ecd-2a42-4e99-9927-df4b87e3075a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:36.411310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f0c13ecd-2a42-4e99-9927-df4b87e3075a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 17 09:33:36.411849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13ecd-2a42-4e99-9927-df4b87e3075a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:36.422017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 2/4] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:33:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:33:36.427815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:36.443946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2bfb-ee79-4634-9018-6207c7a6439a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:36.448322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572d749-71c5-40c8-bd22-9d7b2be18f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:36.449480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572d749-71c5-40c8-bd22-9d7b2be18f22 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:36.449767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572d749-71c5-40c8-bd22-9d7b2be18f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:36.450041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572d749-71c5-40c8-bd22-9d7b2be18f22 admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:36.451684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572d749-71c5-40c8-bd22-9d7b2be18f22 admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:36.508867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3572d749-71c5-40c8-bd22-9d7b2be18f22 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 17 09:33:36.509200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572d749-71c5-40c8-bd22-9d7b2be18f22 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:36.513815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 3/5] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:36 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:38.672258 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5173d-0eff-410e-9891-2da9868323d8 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:38.672887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5173d-0eff-410e-9891-2da9868323d8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:38.673005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5173d-0eff-410e-9891-2da9868323d8 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:38.677460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 3/6] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:38.683528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53dab-0cb9-4626-8d13-1d176ac6421c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:38.684412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53dab-0cb9-4626-8d13-1d176ac6421c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:38.684603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53dab-0cb9-4626-8d13-1d176ac6421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:38.704288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-efb53dab-0cb9-4626-8d13-1d176ac6421c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:38.705821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-efb53dab-0cb9-4626-8d13-1d176ac6421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:38.713828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 4/7] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:38.738095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5173d-0eff-410e-9891-2da9868323d8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:38.750561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5173d-0eff-410e-9891-2da9868323d8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:38.754836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e731463-65b2-406b-957e-54d3dd665f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:38.755467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731463-65b2-406b-957e-54d3dd665f7b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:38.755750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731463-65b2-406b-957e-54d3dd665f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:38.756025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731463-65b2-406b-957e-54d3dd665f7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:38.764235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e731463-65b2-406b-957e-54d3dd665f7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:38.766018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e731463-65b2-406b-957e-54d3dd665f7b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:38.774544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 4/8] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:33:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:33:38.780223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb53dab-0cb9-4626-8d13-1d176ac6421c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:38.789835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb53dab-0cb9-4626-8d13-1d176ac6421c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:38.794294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf33e0a-9fad-4030-9d84-853e60558880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:38.795185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf33e0a-9fad-4030-9d84-853e60558880 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:38.795469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf33e0a-9fad-4030-9d84-853e60558880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:38.795743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf33e0a-9fad-4030-9d84-853e60558880 admin admin] PATH_INFO: `/v3/users/caa8734036c04822b77766dda26302e7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:38.797137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf33e0a-9fad-4030-9d84-853e60558880 admin admin] RBAC: Authorizing `identity:get_user(user_id=caa8734036c04822b77766dda26302e7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:38.799008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf33e0a-9fad-4030-9d84-853e60558880 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:38.800559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 5/9] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:38 2022] GET /identity/v3/users/caa8734036c04822b77766dda26302e7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:41.043571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253a522-4e2e-43b4-8ab5-2900deadbb79 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.044104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253a522-4e2e-43b4-8ab5-2900deadbb79 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.044104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253a522-4e2e-43b4-8ab5-2900deadbb79 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.045867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 5/10] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:41.050987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851e7d-3efd-4e5f-937b-8464b8862dca None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.051440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851e7d-3efd-4e5f-937b-8464b8862dca None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.051548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851e7d-3efd-4e5f-937b-8464b8862dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.069399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-11851e7d-3efd-4e5f-937b-8464b8862dca None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:41.070564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-11851e7d-3efd-4e5f-937b-8464b8862dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:41.078622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 6/11] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:41.101967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253a522-4e2e-43b4-8ab5-2900deadbb79 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:41.105477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6299fd-8832-4073-965f-355798834048 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.105771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6299fd-8832-4073-965f-355798834048 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.106050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6299fd-8832-4073-965f-355798834048 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.108313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 7/12] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:41.113147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac8995-c834-42b2-8161-c5fd7cea9e8d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.113435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac8995-c834-42b2-8161-c5fd7cea9e8d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.113713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac8995-c834-42b2-8161-c5fd7cea9e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.114548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253a522-4e2e-43b4-8ab5-2900deadbb79 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:41.119077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:41.119854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.120139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.120415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.132651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-71ac8995-c834-42b2-8161-c5fd7cea9e8d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:41.133872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-71ac8995-c834-42b2-8161-c5fd7cea9e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:41.136534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:41.142154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 8/13] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:33:41.144028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:33:41.145371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 6/14] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:41.150646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac8995-c834-42b2-8161-c5fd7cea9e8d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:41.160178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac8995-c834-42b2-8161-c5fd7cea9e8d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:41.164543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:41.165198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.165480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.165755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.166523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:41.166923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:41.169210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:41.169210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:33:41.169210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:33:41.170602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:41.171029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:41.181430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9e517-c108-41e8-aa69-16c9e07f5b04 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:41.185970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 9/15] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:41.186648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:41.187342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.187626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.187902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.192196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:41.196617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:41.199888 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:41.202063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d17f7-b888-44cb-b586-118d92e8d5af admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:41.206456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:41.207342 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.207619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.207892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] PATH_INFO: `/v3/users/caa8734036c04822b77766dda26302e7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.209144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] RBAC: Authorizing `identity:get_user(user_id=caa8734036c04822b77766dda26302e7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:41.210907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 7/16] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:33:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:33:41.211180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:41.212747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 10/17] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:41 2022] GET /identity/v3/users/caa8734036c04822b77766dda26302e7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:41.217127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:41.217847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:41.226136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc1cd9-cfaf-4285-a055-a719a096cd2b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:41.227278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ecbe-1f45-440a-872e-5e2d289ce374 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:41.230995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:41.231763 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.232037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.232199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d8ec4-fa0d-4a36-8572-cf6072cae4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:41.232296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.232963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d8ec4-fa0d-4a36-8572-cf6072cae4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.233245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d8ec4-fa0d-4a36-8572-cf6072cae4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.233521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d8ec4-fa0d-4a36-8572-cf6072cae4e9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.233757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:41.234696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d8ec4-fa0d-4a36-8572-cf6072cae4e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:41.235476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:41.236405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d8ec4-fa0d-4a36-8572-cf6072cae4e9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:41.237018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 8/18] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:41.237951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 11/19] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:41.243903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:41.255442 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5919ab-35d6-4371-a773-0d4f2f820ebe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:41.260116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:41.260790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:41.261071 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:41.261345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:41.262245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.domain.id=default, user.id=caa8734036c04822b77766dda26302e7) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:41.262561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:41.264499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:41.264499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:33:41.264499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:33:41.265710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209e22-38c8-4d4e-90a6-2fcd99576f12 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:41.275858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 9/20] 10.222.0.88 () {56 vars in 1343 bytes} [Mon Jan 17 09:33:41 2022] GET /identity/v3/role_assignments?user.id=caa8734036c04822b77766dda26302e7&scope.domain.id=default&role.id=c81c29874f234512920b18621694f614 => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:43.882331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665d1c-d623-49c4-830a-644b30179442 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:43.883277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665d1c-d623-49c4-830a-644b30179442 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:43.883695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665d1c-d623-49c4-830a-644b30179442 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:43.885880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 12/21] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:43.891274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bc1b-e86a-4f78-a5e9-4bcc859612a1 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:43.892081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bc1b-e86a-4f78-a5e9-4bcc859612a1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:43.892582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bc1b-e86a-4f78-a5e9-4bcc859612a1 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:43.894780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 10/22] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:43.897279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497362-e23e-4c67-8390-c45ff3309e0a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:43.897798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497362-e23e-4c67-8390-c45ff3309e0a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:43.898343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497362-e23e-4c67-8390-c45ff3309e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:43.899737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4408fb-e46d-4e34-85fe-087b89537204 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:43.900256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4408fb-e46d-4e34-85fe-087b89537204 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:43.900723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4408fb-e46d-4e34-85fe-087b89537204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:43.942526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-59497362-e23e-4c67-8390-c45ff3309e0a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:43.944117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-59497362-e23e-4c67-8390-c45ff3309e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:43.967989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 13/23] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:43.973717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG passlib.handlers.bcrypt [None req-6f4408fb-e46d-4e34-85fe-087b89537204 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91336) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 17 09:33:43.974460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG passlib.handlers.bcrypt [None req-6f4408fb-e46d-4e34-85fe-087b89537204 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91336) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 17 09:33:44.004046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497362-e23e-4c67-8390-c45ff3309e0a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.021234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497362-e23e-4c67-8390-c45ff3309e0a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.028159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31a024-9a49-483e-b415-c48ed92c3020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.029366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a024-9a49-483e-b415-c48ed92c3020 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.029850 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a024-9a49-483e-b415-c48ed92c3020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.030333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a024-9a49-483e-b415-c48ed92c3020 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.041837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31a024-9a49-483e-b415-c48ed92c3020 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.042147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6f4408fb-e46d-4e34-85fe-087b89537204 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:44.044326 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6f4408fb-e46d-4e34-85fe-087b89537204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:44.045079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31a024-9a49-483e-b415-c48ed92c3020 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.080412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-2b31a024-9a49-483e-b415-c48ed92c3020 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:33:44.084535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 14/24] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:33:44.088003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7c08f-9206-43c5-8e30-5061d8dbab70 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.090616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7c08f-9206-43c5-8e30-5061d8dbab70 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.090923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7c08f-9206-43c5-8e30-5061d8dbab70 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.092943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 15/25] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:44.093511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7c08f-9206-43c5-8e30-5061d8dbab70 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.098352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 11/26] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:44.100315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c682fc3-c2a8-4460-8bd7-45c4f67bcd8e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.100747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c682fc3-c2a8-4460-8bd7-45c4f67bcd8e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.101251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c682fc3-c2a8-4460-8bd7-45c4f67bcd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.132255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4c682fc3-c2a8-4460-8bd7-45c4f67bcd8e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:44.132855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7c08f-9206-43c5-8e30-5061d8dbab70 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.133471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4c682fc3-c2a8-4460-8bd7-45c4f67bcd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:44.144134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.145053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.145540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.145898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 12/27] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:44.146245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.146696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c682fc3-c2a8-4460-8bd7-45c4f67bcd8e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.147440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:44.147942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.149165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:44.149165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:33:44.149165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:33:44.150411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.164139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c682fc3-c2a8-4460-8bd7-45c4f67bcd8e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.179409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843b6e5-d6b3-40b5-99b1-6f4aea594304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.180343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843b6e5-d6b3-40b5-99b1-6f4aea594304 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.180808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843b6e5-d6b3-40b5-99b1-6f4aea594304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.181249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843b6e5-d6b3-40b5-99b1-6f4aea594304 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.182159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843b6e5-d6b3-40b5-99b1-6f4aea594304 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.183292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 16/28] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:44.183464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-a843b6e5-d6b3-40b5-99b1-6f4aea594304 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:44.183464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:33:44.183464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:33:44.186752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843b6e5-d6b3-40b5-99b1-6f4aea594304 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.195997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.210278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c78db-4fc6-479b-82ae-2580fb32d1bb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.215480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.216151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.216432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.216707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.217447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.218583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:44.218583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:33:44.218583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:33:44.219855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.503860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 13/29] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:33:44 2022] POST /identity/v3/roles => generated 219 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:44.504076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 17/30] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:33:44 2022] POST /identity/v3/projects => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:33:44.504874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.566530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ec70-fc04-4aa5-97a8-20423cd789f1 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.567050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ec70-fc04-4aa5-97a8-20423cd789f1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.567845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ec70-fc04-4aa5-97a8-20423cd789f1 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.575463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 14/31] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:33:44.592991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc93819-4ef4-4697-bb60-07880a5b0e1e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.597386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a291-c6fd-406d-a7c8-26e56ad6baa4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.598223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a291-c6fd-406d-a7c8-26e56ad6baa4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.599010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a291-c6fd-406d-a7c8-26e56ad6baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.606010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.606798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.607078 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.607356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.628953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:44.635919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:33:44.643635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 18/32] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:44.649435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.656280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6cf9a291-c6fd-406d-a7c8-26e56ad6baa4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:44.663409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6cf9a291-c6fd-406d-a7c8-26e56ad6baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:44.664800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988563dd-4d41-4afb-b96c-1fd8217cc621 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.678346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.679866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.680152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.680430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.681232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:44.681543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.683999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.693289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 15/33] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:33:44.712193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 19/34] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:44.718162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9a291-c6fd-406d-a7c8-26e56ad6baa4 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.747022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9a291-c6fd-406d-a7c8-26e56ad6baa4 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.762492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.762492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.762492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.762492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] PATH_INFO: `/v3/users/caa8734036c04822b77766dda26302e7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.763066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] RBAC: Authorizing `identity:get_user(user_id=caa8734036c04822b77766dda26302e7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.763720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.771683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 16/35] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:44 2022] GET /identity/v3/users/caa8734036c04822b77766dda26302e7 => generated 247 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:44.773951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.777465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.791822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025910-34fc-4293-acb2-7d82942c0c92 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.800821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.801642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.802016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.802470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.802752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204dfcb-c610-417f-a13b-ae36503e3697 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.803812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.805809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.807509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 17/36] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:44.814137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:44.827543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505ed4-aa5b-4e04-a772-f32728b16057 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:44.828833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d690-aa07-4411-824f-df5a1a04708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.829947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d690-aa07-4411-824f-df5a1a04708d admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.830433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d690-aa07-4411-824f-df5a1a04708d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.830938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d690-aa07-4411-824f-df5a1a04708d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.832294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d690-aa07-4411-824f-df5a1a04708d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.834150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-2804d690-aa07-4411-824f-df5a1a04708d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:44.834150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:33:44.834150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:33:44.835831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d690-aa07-4411-824f-df5a1a04708d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.836004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29858c3f-3776-460a-8963-ed23be559670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:44.836796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858c3f-3776-460a-8963-ed23be559670 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:44.837133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858c3f-3776-460a-8963-ed23be559670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:44.837475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858c3f-3776-460a-8963-ed23be559670 admin admin] PATH_INFO: `/v3/domains/default/users/caa8734036c04822b77766dda26302e7/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:44.839771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29858c3f-3776-460a-8963-ed23be559670 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=caa8734036c04822b77766dda26302e7, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:44.840993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-29858c3f-3776-460a-8963-ed23be559670 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:44.840993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:33:44.840993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:33:44.843224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29858c3f-3776-460a-8963-ed23be559670 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:44.986837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 18/37] 10.222.0.88 () {58 vars in 1382 bytes} [Mon Jan 17 09:33:44 2022] PUT /identity/v3/domains/default/users/caa8734036c04822b77766dda26302e7/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:33:45.020855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 20/38] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:33:44 2022] POST /identity/v3/roles => generated 225 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:45.469992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b742da-f19e-40c4-96e2-cad6b46d31cc None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:45.470279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b742da-f19e-40c4-96e2-cad6b46d31cc None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:45.470660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b742da-f19e-40c4-96e2-cad6b46d31cc None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:45.472540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 19/39] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:45.478704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d93e5-d2a5-419c-8ec6-0b946b75610f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:45.479133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d93e5-d2a5-419c-8ec6-0b946b75610f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:45.479488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d93e5-d2a5-419c-8ec6-0b946b75610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:45.501683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-825d93e5-d2a5-419c-8ec6-0b946b75610f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:45.503378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-825d93e5-d2a5-419c-8ec6-0b946b75610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:45.568096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 21/40] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:45.592209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b742da-f19e-40c4-96e2-cad6b46d31cc None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:45.604697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b742da-f19e-40c4-96e2-cad6b46d31cc None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:45.609216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254360f-0f2e-4316-a04b-808dd598ec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:45.609883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254360f-0f2e-4316-a04b-808dd598ec16 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:45.610166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254360f-0f2e-4316-a04b-808dd598ec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:45.610449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254360f-0f2e-4316-a04b-808dd598ec16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:45.611263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254360f-0f2e-4316-a04b-808dd598ec16 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:45.613053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254360f-0f2e-4316-a04b-808dd598ec16 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:45.706165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 20/41] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:33:45 2022] POST /identity/v3/roles => generated 223 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:45.722261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54b5f-95ea-425c-999e-5b569626b010 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:45.722589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54b5f-95ea-425c-999e-5b569626b010 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:45.722871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54b5f-95ea-425c-999e-5b569626b010 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:45.724953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 22/42] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:45.731348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0104d-9c2e-45dc-8859-cf49bc591f37 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:45.731688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0104d-9c2e-45dc-8859-cf49bc591f37 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:45.731922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0104d-9c2e-45dc-8859-cf49bc591f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:45.751834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-aed0104d-9c2e-45dc-8859-cf49bc591f37 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:45.753052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-aed0104d-9c2e-45dc-8859-cf49bc591f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:45.761722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 21/43] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:45.786061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e54b5f-95ea-425c-999e-5b569626b010 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:45.799464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e54b5f-95ea-425c-999e-5b569626b010 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:45.803894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703401d1-c773-421c-a398-e0c91313860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:45.804710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703401d1-c773-421c-a398-e0c91313860c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:45.804990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703401d1-c773-421c-a398-e0c91313860c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:45.805270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703401d1-c773-421c-a398-e0c91313860c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:45.806534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703401d1-c773-421c-a398-e0c91313860c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:45.808377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703401d1-c773-421c-a398-e0c91313860c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:45.810985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 23/44] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:45.816473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0104d-9c2e-45dc-8859-cf49bc591f37 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:45.826066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0104d-9c2e-45dc-8859-cf49bc591f37 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:45.830827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d5c7-f4a2-4e90-9263-c59c62653c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:45.833712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d5c7-f4a2-4e90-9263-c59c62653c36 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:45.833712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d5c7-f4a2-4e90-9263-c59c62653c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:45.833712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d5c7-f4a2-4e90-9263-c59c62653c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:45.834004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d5c7-f4a2-4e90-9263-c59c62653c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:45.835042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-3314d5c7-f4a2-4e90-9263-c59c62653c36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:45.835042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:33:45.835042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:33:45.836406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d5c7-f4a2-4e90-9263-c59c62653c36 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:45.957572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 22/45] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:33:45 2022] POST /identity/v3/projects => generated 312 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:47.240630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4e6b-0967-4a5e-b3fe-9a1ab898817d None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:47.241154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4e6b-0967-4a5e-b3fe-9a1ab898817d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:47.241266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4e6b-0967-4a5e-b3fe-9a1ab898817d None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:47.243166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 24/46] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:47.248642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c0b5-a8cf-4cf5-ab17-65b7bb376644 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:47.249056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c0b5-a8cf-4cf5-ab17-65b7bb376644 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:47.249201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c0b5-a8cf-4cf5-ab17-65b7bb376644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:47.267636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-ac84c0b5-a8cf-4cf5-ab17-65b7bb376644 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:47.268814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ac84c0b5-a8cf-4cf5-ab17-65b7bb376644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:47.344126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 23/47] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:47.367492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda4e6b-0967-4a5e-b3fe-9a1ab898817d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:47.381767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda4e6b-0967-4a5e-b3fe-9a1ab898817d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:47.386189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:47.386996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:47.387279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:47.387565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:47.397744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:47.404395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:33:47.405555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 25/48] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:47.411784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c0b5-a8cf-4cf5-ab17-65b7bb376644 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:47.421211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c0b5-a8cf-4cf5-ab17-65b7bb376644 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:47.425693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:47.426419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:47.426809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:47.427095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:47.427867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:47.428177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:47.429198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:47.429198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:33:47.429198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:33:47.430121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:47.443632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 24/49] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:47.448835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:47.459703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ae4c-0085-456f-a5bf-4239c513f934 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:47.464303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831718-925d-4564-a124-715aeeba248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:47.465163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831718-925d-4564-a124-715aeeba248d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:47.465448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831718-925d-4564-a124-715aeeba248d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:47.465733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831718-925d-4564-a124-715aeeba248d admin admin] PATH_INFO: `/v3/users/caa8734036c04822b77766dda26302e7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:47.466990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03831718-925d-4564-a124-715aeeba248d admin admin] RBAC: Authorizing `identity:get_user(user_id=caa8734036c04822b77766dda26302e7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:47.468879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03831718-925d-4564-a124-715aeeba248d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:47.470644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 26/50] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:47 2022] GET /identity/v3/users/caa8734036c04822b77766dda26302e7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:47.475760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:47.485807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a06735-9f5c-45c1-8bf2-bd539f4f7fac admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:47.490155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fe33a-c254-49e9-aec3-9519743b8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:47.491020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fe33a-c254-49e9-aec3-9519743b8f3c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:47.491256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fe33a-c254-49e9-aec3-9519743b8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:47.491528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fe33a-c254-49e9-aec3-9519743b8f3c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:47.492745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fe33a-c254-49e9-aec3-9519743b8f3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:47.494457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fe33a-c254-49e9-aec3-9519743b8f3c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:47.496678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 25/51] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:47.502390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831718-925d-4564-a124-715aeeba248d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:47.512167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831718-925d-4564-a124-715aeeba248d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:47.516575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:47.523045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:47.523045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:47.523045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:47.523045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.domain.id=default, user.id=caa8734036c04822b77766dda26302e7) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:47.523045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:47.523405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:47.523405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:33:47.523405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:33:47.523405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ccfa4-6a13-4dce-931e-43222aa61de2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:47.528870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 27/52] 10.222.0.88 () {56 vars in 1343 bytes} [Mon Jan 17 09:33:47 2022] GET /identity/v3/role_assignments?user.id=caa8734036c04822b77766dda26302e7&scope.domain.id=default&role.id=c81c29874f234512920b18621694f614 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:48.156400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8837f-f10c-43d8-a515-dcaec43379e4 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:48.156678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8837f-f10c-43d8-a515-dcaec43379e4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:48.156961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8837f-f10c-43d8-a515-dcaec43379e4 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:48.159024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 26/53] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:48.164570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872ceb2-1d74-4c80-bbf8-97fa8565690c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:48.164863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872ceb2-1d74-4c80-bbf8-97fa8565690c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:48.165147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872ceb2-1d74-4c80-bbf8-97fa8565690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:48.182636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4872ceb2-1d74-4c80-bbf8-97fa8565690c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:48.183876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4872ceb2-1d74-4c80-bbf8-97fa8565690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:48.191488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 28/54] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:48.214709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8837f-f10c-43d8-a515-dcaec43379e4 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:48.227243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8837f-f10c-43d8-a515-dcaec43379e4 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:48.231473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f151e59-1f22-4c6e-abeb-d86b14298dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:48.232249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151e59-1f22-4c6e-abeb-d86b14298dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:48.232625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151e59-1f22-4c6e-abeb-d86b14298dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:48.232897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151e59-1f22-4c6e-abeb-d86b14298dd1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:48.234194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f151e59-1f22-4c6e-abeb-d86b14298dd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:48.235938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f151e59-1f22-4c6e-abeb-d86b14298dd1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:48.237498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 27/55] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:48.242782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872ceb2-1d74-4c80-bbf8-97fa8565690c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:48.251917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872ceb2-1d74-4c80-bbf8-97fa8565690c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:48.256358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8da2bb-d14b-42c3-82bf-2fd8124c7c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:48.257010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da2bb-d14b-42c3-82bf-2fd8124c7c5f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:48.257297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da2bb-d14b-42c3-82bf-2fd8124c7c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:48.257577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da2bb-d14b-42c3-82bf-2fd8124c7c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:48.258315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8da2bb-d14b-42c3-82bf-2fd8124c7c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:48.260304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8da2bb-d14b-42c3-82bf-2fd8124c7c5f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:48.351540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 29/56] 10.222.0.88 () {60 vars in 1161 bytes} [Mon Jan 17 09:33:48 2022] POST /identity/v3/projects => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:50.551598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cecf-726c-4974-896a-e09b82b2a32d None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:50.552144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cecf-726c-4974-896a-e09b82b2a32d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:50.552144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cecf-726c-4974-896a-e09b82b2a32d None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:50.553924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 28/57] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:50.559710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea58b82-d8dd-458e-ad9d-9b0fc70db7f1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:50.560080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea58b82-d8dd-458e-ad9d-9b0fc70db7f1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:50.560275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea58b82-d8dd-458e-ad9d-9b0fc70db7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:50.578335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9ea58b82-d8dd-458e-ad9d-9b0fc70db7f1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:50.579552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9ea58b82-d8dd-458e-ad9d-9b0fc70db7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:50.634492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 30/58] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:50.659624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cecf-726c-4974-896a-e09b82b2a32d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:50.671469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cecf-726c-4974-896a-e09b82b2a32d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:50.675765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d317115-ec44-41b4-9091-307dda6eabe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:50.676533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317115-ec44-41b4-9091-307dda6eabe4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:50.676814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317115-ec44-41b4-9091-307dda6eabe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:50.677087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317115-ec44-41b4-9091-307dda6eabe4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:50.678253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d317115-ec44-41b4-9091-307dda6eabe4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:50.680004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d317115-ec44-41b4-9091-307dda6eabe4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:50.681537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 29/59] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:50.687093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea58b82-d8dd-458e-ad9d-9b0fc70db7f1 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:50.695994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea58b82-d8dd-458e-ad9d-9b0fc70db7f1 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:50.701026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030d9e-c681-4cb1-98de-b9ab1d1c8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:50.701681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030d9e-c681-4cb1-98de-b9ab1d1c8605 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:50.701992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030d9e-c681-4cb1-98de-b9ab1d1c8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:50.702273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030d9e-c681-4cb1-98de-b9ab1d1c8605 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:50.703048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030d9e-c681-4cb1-98de-b9ab1d1c8605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:50.704080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-f9030d9e-c681-4cb1-98de-b9ab1d1c8605 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:50.704080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:33:50.704080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:33:50.705318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030d9e-c681-4cb1-98de-b9ab1d1c8605 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:50.836597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 31/60] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:33:50 2022] POST /identity/v3/users => generated 275 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:54.148821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08983-fe1f-4160-bff3-4976e8c154cd None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.149339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08983-fe1f-4160-bff3-4976e8c154cd None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.149339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08983-fe1f-4160-bff3-4976e8c154cd None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.151229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 30/61] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:54.168693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c653a-d973-41db-b105-524ba6b2434a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.169635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c653a-d973-41db-b105-524ba6b2434a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.170113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c653a-d973-41db-b105-524ba6b2434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.200225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-668c653a-d973-41db-b105-524ba6b2434a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:54.201771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-668c653a-d973-41db-b105-524ba6b2434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:54.211226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 32/62] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:54.250705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08983-fe1f-4160-bff3-4976e8c154cd None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.268745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08983-fe1f-4160-bff3-4976e8c154cd None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.276713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.278164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.278446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.278720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.300575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:54.307751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:33:54.309859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 31/63] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:54.315821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c653a-d973-41db-b105-524ba6b2434a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.331991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c653a-d973-41db-b105-524ba6b2434a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.347149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f8ad1-c6e9-4df7-aa6d-a778a671b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.348327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f8ad1-c6e9-4df7-aa6d-a778a671b53c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.348827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f8ad1-c6e9-4df7-aa6d-a778a671b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.349299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f8ad1-c6e9-4df7-aa6d-a778a671b53c admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.350367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f8ad1-c6e9-4df7-aa6d-a778a671b53c admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:54.350907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f8ad1-c6e9-4df7-aa6d-a778a671b53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.352807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f8ad1-c6e9-4df7-aa6d-a778a671b53c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.377123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 33/64] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.382908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.392871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6858f-3cc8-4230-b931-347f2cb92443 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.393465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6858f-3cc8-4230-b931-347f2cb92443 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.393940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6858f-3cc8-4230-b931-347f2cb92443 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.396307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 34/65] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:33:54.398694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841d01-87a0-42f9-af38-5c62a1b76e7c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.401740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ae1d-496e-4ac6-a89e-8e683f3ff5af None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.402493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ae1d-496e-4ac6-a89e-8e683f3ff5af None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.402804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ae1d-496e-4ac6-a89e-8e683f3ff5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.412307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.413251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.413534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.413810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.435639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2d11ae1d-496e-4ac6-a89e-8e683f3ff5af None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:54.436831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2d11ae1d-496e-4ac6-a89e-8e683f3ff5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:54.444361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.446628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.453269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 32/66] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:54.454123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.456052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 35/67] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:33:54.472927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42716f79-6a15-44c9-8425-af07abb205cf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.483029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.483695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.483982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.484324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.487039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb183ad-6093-49c8-9a8b-f4b70b8b4161 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.487338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb183ad-6093-49c8-9a8b-f4b70b8b4161 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.487612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb183ad-6093-49c8-9a8b-f4b70b8b4161 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.489509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 36/68] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:33:54.494644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc861d-d18a-462a-87aa-c13593424b1b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.494951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc861d-d18a-462a-87aa-c13593424b1b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.495225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc861d-d18a-462a-87aa-c13593424b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.505534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.507395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.513899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2fbc861d-d18a-462a-87aa-c13593424b1b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:54.515352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2fbc861d-d18a-462a-87aa-c13593424b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:54.517125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 33/69] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:33:54.518003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.524183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 37/70] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:33:54.525318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc861d-d18a-462a-87aa-c13593424b1b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.535831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc861d-d18a-462a-87aa-c13593424b1b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.539595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9394509-fe5f-46e8-8d45-85d5d3305f24 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.540917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.542004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.543102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.543523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.545241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.547649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.549990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 38/71] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.551444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.551951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.552946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.553374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.553817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.562395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ac16-549e-4dbe-a1be-adce928f2311 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.566038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:54.566933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.567730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.568016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.568292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.574243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:33:54.579515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:54.580480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 34/72] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:54.581581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.587474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:33:54.589183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 39/73] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:54.590628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.597664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95f28-f7ee-46b1-9c9c-27cd3401d48e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.602435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41c9e-0e01-4b70-833e-7f1db910e9a8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.602868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.603693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.604125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.604548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.606112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=2ce7244afa9e4badaf5a397a60aa4c51) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:54.606587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.607628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.608293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.608575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.608854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.609340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.609616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:54.609998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.611791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.617145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 35/74] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/role_assignments?user.id=2ce7244afa9e4badaf5a397a60aa4c51&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=195819215583470b80fa053d7de42a6c => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.618686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.622219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 40/75] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.635880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.642481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3357a8-22d8-4b13-8252-7ceacc47deca admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.653321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0f8d1-bb16-48e5-8ba9-59d3385a78f1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.661112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.662716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.664592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.665348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.668067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:54.669825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.673832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.679054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.680393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.680938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.681407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.685087 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.687917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.694509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 41/76] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.698394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 36/77] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.706280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.707966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.726995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f77c32-5cb3-46a0-86a6-7e048f95b9de admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.732019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797749c-0abe-42d5-bd8e-548730a4be8d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.737817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.739211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.740709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.741656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.744373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.748562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.749275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.749830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] PATH_INFO: `/v3/users/caa8734036c04822b77766dda26302e7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.753601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] RBAC: Authorizing `identity:get_user(user_id=caa8734036c04822b77766dda26302e7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.757095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.760482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 37/78] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/users/caa8734036c04822b77766dda26302e7 => generated 247 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.768338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.770663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.778704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.790091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2c5b8-716b-4e09-9feb-f9e786ff8e97 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.793567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 42/79] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:33:54.802633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.803363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.804343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.804858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.805384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.815085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.817235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.818301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9dc84-be53-4447-9136-d10b598a17ef admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.828683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 38/80] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:33:54.834961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.836473 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.838140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.838668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.839292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.843682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.846336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.848028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 43/81] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:54.851656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e050afb-8e09-413a-a004-0268ab633726 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.856620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.866609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.867615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.867980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.868337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.871358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.873602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.876685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 39/82] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:54.887418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aae1ae-00b2-4d17-b59d-608ded1f1fd1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.890790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:54.902993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b456daa-8520-46e4-afa1-1c6d9764ca81 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:54.905839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ed3e7-5255-4e6d-b3e1-ea7795acb037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.906454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed3e7-5255-4e6d-b3e1-ea7795acb037 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.906752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed3e7-5255-4e6d-b3e1-ea7795acb037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.907050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed3e7-5255-4e6d-b3e1-ea7795acb037 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.907934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ed3e7-5255-4e6d-b3e1-ea7795acb037 admin admin] RBAC: Adding query filter params (role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=2ce7244afa9e4badaf5a397a60aa4c51) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:54.908365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ed3e7-5255-4e6d-b3e1-ea7795acb037 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.911200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ed3e7-5255-4e6d-b3e1-ea7795acb037 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.918255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 44/83] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/role_assignments?user.id=2ce7244afa9e4badaf5a397a60aa4c51&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:54.919260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60583bd5-cd32-42ed-b522-b548c1d6e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:54.920213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583bd5-cd32-42ed-b522-b548c1d6e16f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.920720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583bd5-cd32-42ed-b522-b548c1d6e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.921213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583bd5-cd32-42ed-b522-b548c1d6e16f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.922382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60583bd5-cd32-42ed-b522-b548c1d6e16f admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=caa8734036c04822b77766dda26302e7) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:54.923029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60583bd5-cd32-42ed-b522-b548c1d6e16f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:54.925282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60583bd5-cd32-42ed-b522-b548c1d6e16f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:54.940106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 40/84] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:33:54 2022] GET /identity/v3/role_assignments?user.id=caa8734036c04822b77766dda26302e7&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:54.959621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304e8-b281-468a-ba87-900393d39346 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.959960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304e8-b281-468a-ba87-900393d39346 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.960241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304e8-b281-468a-ba87-900393d39346 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.962619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 45/85] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:54.968382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7bcc7-56ba-41aa-9a8f-a2caa83e80ae None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:54.969040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7bcc7-56ba-41aa-9a8f-a2caa83e80ae None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:54.969573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7bcc7-56ba-41aa-9a8f-a2caa83e80ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:54.996990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-50c7bcc7-56ba-41aa-9a8f-a2caa83e80ae None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:54.998638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-50c7bcc7-56ba-41aa-9a8f-a2caa83e80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:55.010942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 41/86] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:55.040792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304e8-b281-468a-ba87-900393d39346 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.060883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304e8-b281-468a-ba87-900393d39346 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.066410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.067317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.067601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.067937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.086169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:55.093733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:33:55.095279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 46/87] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:55.102710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7bcc7-56ba-41aa-9a8f-a2caa83e80ae None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.116479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7bcc7-56ba-41aa-9a8f-a2caa83e80ae None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.129121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.129836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.130127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.130407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.131256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:55.131567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:55.133272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:55.149229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 42/88] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:33:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:55.155794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.169912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284a76-7653-41a6-a6b3-eb330b144253 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.176533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.177474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.177761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.178041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.180181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:55.182646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:55.185101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 47/89] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:55 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:55.190588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.201607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86008a-91c6-4354-9f56-a053ae54ab96 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.206606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.207348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.207633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.207970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.218765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:55.220653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:55.235626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 43/90] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:33:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:33:55.244409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.256714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f01d4-3f50-4c4e-9647-6293459a9c2f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.263168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff995b1-77cb-4c30-b7ac-c82a4a729c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.264045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff995b1-77cb-4c30-b7ac-c82a4a729c3b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.264336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff995b1-77cb-4c30-b7ac-c82a4a729c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.264614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff995b1-77cb-4c30-b7ac-c82a4a729c3b admin admin] PATH_INFO: `/v3/projects/7b3b3473ad92488caaf1e521716529c2` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.266093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff995b1-77cb-4c30-b7ac-c82a4a729c3b admin admin] RBAC: Authorizing `identity:get_project(project_id=7b3b3473ad92488caaf1e521716529c2)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:55.268272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff995b1-77cb-4c30-b7ac-c82a4a729c3b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:55.270355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 48/91] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:55 2022] GET /identity/v3/projects/7b3b3473ad92488caaf1e521716529c2 => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:55.276021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.288323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c19e-dc47-4bc2-a3ce-30f4c48acb07 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.289027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb929-b63f-4f8d-931a-6c53eb6fd735 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.289347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb929-b63f-4f8d-931a-6c53eb6fd735 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.289635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb929-b63f-4f8d-931a-6c53eb6fd735 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.293849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 49/92] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:55.298621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.299555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.299729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd58d2c-50d1-40b1-8559-f6c8f1fc120f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.299918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd58d2c-50d1-40b1-8559-f6c8f1fc120f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.300068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.300243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd58d2c-50d1-40b1-8559-f6c8f1fc120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.300596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.301837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, scope.project.id=7b3b3473ad92488caaf1e521716529c2, user.id=2ce7244afa9e4badaf5a397a60aa4c51) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:55.302172 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:55.304650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:55.312808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 44/93] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:33:55 2022] GET /identity/v3/role_assignments?user.id=2ce7244afa9e4badaf5a397a60aa4c51&scope.project.id=7b3b3473ad92488caaf1e521716529c2&role.id=195819215583470b80fa053d7de42a6c => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:55.345689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4dd58d2c-50d1-40b1-8559-f6c8f1fc120f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:55.347103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4dd58d2c-50d1-40b1-8559-f6c8f1fc120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:55.370647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 50/94] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:55.421512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.432075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb26bca-1856-4998-aba3-fc34ee1622e2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.442549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07616cb-fb27-4f82-afd0-a21d3d41cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.443398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07616cb-fb27-4f82-afd0-a21d3d41cad8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.443737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07616cb-fb27-4f82-afd0-a21d3d41cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.444011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07616cb-fb27-4f82-afd0-a21d3d41cad8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.445342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07616cb-fb27-4f82-afd0-a21d3d41cad8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:55.447187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07616cb-fb27-4f82-afd0-a21d3d41cad8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:55.449499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 45/95] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:55.455439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd58d2c-50d1-40b1-8559-f6c8f1fc120f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:55.466543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd58d2c-50d1-40b1-8559-f6c8f1fc120f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:55.489801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a30e9-d36b-4645-bb4c-f8ce12c89074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:55.491037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a30e9-d36b-4645-bb4c-f8ce12c89074 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:55.491564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a30e9-d36b-4645-bb4c-f8ce12c89074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:55.492074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a30e9-d36b-4645-bb4c-f8ce12c89074 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:55.493521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a30e9-d36b-4645-bb4c-f8ce12c89074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:55.496481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a30e9-d36b-4645-bb4c-f8ce12c89074 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:55.600281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 51/96] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:33:55 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:57.549452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd40ae-f650-498b-a9aa-6a88fbae1010 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.550011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd40ae-f650-498b-a9aa-6a88fbae1010 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.550011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd40ae-f650-498b-a9aa-6a88fbae1010 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.551824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 46/97] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:57.557355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c2c3-9fe2-4385-9564-4c6bf25ab638 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.558781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c2c3-9fe2-4385-9564-4c6bf25ab638 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.559281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c2c3-9fe2-4385-9564-4c6bf25ab638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.617512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4566c2c3-9fe2-4385-9564-4c6bf25ab638 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:57.623184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4566c2c3-9fe2-4385-9564-4c6bf25ab638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:57.631368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 52/98] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:57.663216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd40ae-f650-498b-a9aa-6a88fbae1010 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.675778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb834ac-8158-4120-9361-2c68405d5f43 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.676094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb834ac-8158-4120-9361-2c68405d5f43 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.676296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb834ac-8158-4120-9361-2c68405d5f43 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.678214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 53/99] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:33:57.681264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd40ae-f650-498b-a9aa-6a88fbae1010 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.690434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.691422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4ce9-c78a-4edc-aef3-f112eefe8705 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.691645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.691911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.692190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.692560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4ce9-c78a-4edc-aef3-f112eefe8705 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.693038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4ce9-c78a-4edc-aef3-f112eefe8705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.703593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:57.711096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:33:57.712621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 47/100] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:57.717380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-5adb4ce9-c78a-4edc-aef3-f112eefe8705 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:57.718752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.720564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5adb4ce9-c78a-4edc-aef3-f112eefe8705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:57.733347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c1821-616c-450c-8df7-3f505641a6b3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.742766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.742766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.742766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.742766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.743324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:57.743324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:57.743324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:57.745081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 54/101] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:57.762124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 48/102] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:57.767960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb4ce9-c78a-4edc-aef3-f112eefe8705 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.780116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb4ce9-c78a-4edc-aef3-f112eefe8705 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.785184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.787500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.788387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.788668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.788945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] PATH_INFO: `/v3/users/caa8734036c04822b77766dda26302e7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.790164 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=caa8734036c04822b77766dda26302e7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:57.792048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:57.798742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 55/103] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/users/caa8734036c04822b77766dda26302e7 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:57.799695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9ea0d-175c-4202-ba66-38418a33be51 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.799927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.811579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62401-5fa7-4928-a533-ad314b4229f5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.812514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.813410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.813924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.814420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.828364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.829251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.829533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.829808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.831056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:57.833302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:57.835186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 56/104] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:57.839024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:57.841189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.846424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:33:57.848203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 49/105] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:33:57.858864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.860649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929f5bf-9600-485a-b57b-ea7dc7b58857 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.870528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace0a2-e942-4962-bff0-b1c1886eaba2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.876491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.877347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.877632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.877910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/caa8734036c04822b77766dda26302e7/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.880061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd, user_id=caa8734036c04822b77766dda26302e7, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:57.881118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:33:57.881118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:33:57.881118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:33:57.883193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:57.884902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.885820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.886388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.886901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.887942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:57.888459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:57.890370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:57.907019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 50/106] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:57.912597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.923615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8347b6-463f-4f6f-ba26-58b3ab463378 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.935861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba203a-8f95-47eb-b905-e2a449f71e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.937069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba203a-8f95-47eb-b905-e2a449f71e31 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.937532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba203a-8f95-47eb-b905-e2a449f71e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.937986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba203a-8f95-47eb-b905-e2a449f71e31 admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.939497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba203a-8f95-47eb-b905-e2a449f71e31 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:57.941842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba203a-8f95-47eb-b905-e2a449f71e31 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:57.943885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 51/107] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:57.945310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee6f8-111c-4219-ab82-ea36a58c939d None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.945786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee6f8-111c-4219-ab82-ea36a58c939d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.946252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee6f8-111c-4219-ab82-ea36a58c939d None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.948173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 52/108] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:57.950641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee6f8-111c-4219-ab82-ea36a58c939d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:57.964418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee6f8-111c-4219-ab82-ea36a58c939d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:57.969410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be483-0b15-4346-b5b9-2a2fd03de66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:57.970505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be483-0b15-4346-b5b9-2a2fd03de66e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.971013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be483-0b15-4346-b5b9-2a2fd03de66e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.971655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be483-0b15-4346-b5b9-2a2fd03de66e admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.973449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be483-0b15-4346-b5b9-2a2fd03de66e admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:57.975907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be483-0b15-4346-b5b9-2a2fd03de66e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:57.977842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 53/109] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:57 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:57.979312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76360e-b4b0-4bc2-87cc-cfd95b84a202 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:57.980370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76360e-b4b0-4bc2-87cc-cfd95b84a202 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:57.980828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76360e-b4b0-4bc2-87cc-cfd95b84a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:57.997872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 57/110] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:33:57 2022] PUT /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/caa8734036c04822b77766dda26302e7/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:33:58.003265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.003387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8f76360e-b4b0-4bc2-87cc-cfd95b84a202 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:58.003387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8f76360e-b4b0-4bc2-87cc-cfd95b84a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:58.070512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 54/111] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:58.072223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd29f3-c202-4e69-9248-ee58d4b88685 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.072703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd29f3-c202-4e69-9248-ee58d4b88685 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.073175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd29f3-c202-4e69-9248-ee58d4b88685 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.075535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 55/112] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:58.081281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c9fb-d7ed-41a8-9ab4-7b2c97a4a29c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.081799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c9fb-d7ed-41a8-9ab4-7b2c97a4a29c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.082271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c9fb-d7ed-41a8-9ab4-7b2c97a4a29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.117828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f729c9fb-d7ed-41a8-9ab4-7b2c97a4a29c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:58.120359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f729c9fb-d7ed-41a8-9ab4-7b2c97a4a29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:58.141438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 56/113] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:33:58.143988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729c9fb-d7ed-41a8-9ab4-7b2c97a4a29c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.150789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc9784-823b-46c0-9c8d-1209683e140c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.161935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.163599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.165383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.166552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729c9fb-d7ed-41a8-9ab4-7b2c97a4a29c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.166912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/2ce7244afa9e4badaf5a397a60aa4c51/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.171650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd, user_id=2ce7244afa9e4badaf5a397a60aa4c51, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.177105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.178458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.179468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.179995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.180976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.197495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:58.205580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:33:58.207258 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 57/114] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:58.208367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.220204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03b87-1e39-4c70-b0b0-56907e8ecb1f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.227365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.229479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.231020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.231875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.249361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:58.257719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:33:58.259296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 58/115] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:33:58.260314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.271100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d35d2-e85c-417a-96ed-12c3c7307ccc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.277490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.278223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.278508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.278953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.279781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] RBAC: Adding query filter params (name=member) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:58.280096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.281796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.293721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 59/116] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:58.298858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.300275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 58/117] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:33:57 2022] PUT /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/2ce7244afa9e4badaf5a397a60aa4c51/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:33:58.300971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.311268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52699-0294-4a1a-9141-eaa280d577cd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.382023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.382965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.383348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.383720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.384900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:33:58.385320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.388713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.391378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6b02-7b55-4726-9fc0-bed5b15bacdf admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.396299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.397526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.397976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.398449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.399951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.400159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 60/118] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:58.403159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.405138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 59/119] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:58.410771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.411805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.418519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10fc93-206a-4dd7-ab74-5282ae84b216 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.425150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.426418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.427074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.427518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.429291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.429774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e310-63c0-4d69-afc9-3c1dfa482bfc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.432262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.434835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 61/120] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:58.440683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.449537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.450668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.451119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.451541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] PATH_INFO: `/v3/projects/7b3b3473ad92488caaf1e521716529c2` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.453923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a43d-74d8-4408-8107-ca8c34e98e84 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.454855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] RBAC: Authorizing `identity:get_project(project_id=7b3b3473ad92488caaf1e521716529c2)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.457096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.459199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 60/121] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/projects/7b3b3473ad92488caaf1e521716529c2 => generated 312 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:58.462754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.462754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.462754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.462754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.463680 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.465563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.466948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.469006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 62/122] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:33:58 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:33:58.475271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:58.485947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46abc9d-d4b1-45a4-afb6-287c3e76d502 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.487664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eed0b-7d2b-478d-aa1d-45d77730445d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:58.493520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196a3af-5fc6-44df-99ec-963cb33a045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.494757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a3af-5fc6-44df-99ec-963cb33a045b admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.495243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a3af-5fc6-44df-99ec-963cb33a045b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.495697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a3af-5fc6-44df-99ec-963cb33a045b admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/2ce7244afa9e4badaf5a397a60aa4c51/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.498463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196a3af-5fc6-44df-99ec-963cb33a045b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd, user_id=2ce7244afa9e4badaf5a397a60aa4c51, role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.502077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196a3af-5fc6-44df-99ec-963cb33a045b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.503083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed2ad0-0384-40ec-a5da-536b006a95a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:58.503990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2ad0-0384-40ec-a5da-536b006a95a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:58.504271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2ad0-0384-40ec-a5da-536b006a95a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:58.504548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2ad0-0384-40ec-a5da-536b006a95a8 admin admin] PATH_INFO: `/v3/projects/7b3b3473ad92488caaf1e521716529c2/users/2ce7244afa9e4badaf5a397a60aa4c51/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:58.512734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed2ad0-0384-40ec-a5da-536b006a95a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3b3473ad92488caaf1e521716529c2, user_id=2ce7244afa9e4badaf5a397a60aa4c51, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:58.518008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed2ad0-0384-40ec-a5da-536b006a95a8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:58.676361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 63/123] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:33:58 2022] PUT /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/2ce7244afa9e4badaf5a397a60aa4c51/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:33:58.949719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 61/124] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:33:58 2022] PUT /identity/v3/projects/7b3b3473ad92488caaf1e521716529c2/users/2ce7244afa9e4badaf5a397a60aa4c51/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:33:59.641138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad23cc-921d-45f8-88b8-752759c005ef None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:59.641691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad23cc-921d-45f8-88b8-752759c005ef None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:59.642083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad23cc-921d-45f8-88b8-752759c005ef None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:59.644035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 64/125] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:33:59.649581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ed33-225a-4c37-9595-e02f26d19d8d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:59.650034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ed33-225a-4c37-9595-e02f26d19d8d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:59.650449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ed33-225a-4c37-9595-e02f26d19d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:59.688011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d674ed33-225a-4c37-9595-e02f26d19d8d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:59.689533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d674ed33-225a-4c37-9595-e02f26d19d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:59.763928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 62/126] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:33:59.800113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad23cc-921d-45f8-88b8-752759c005ef None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:59.817920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad23cc-921d-45f8-88b8-752759c005ef None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:59.822451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18c721-b759-4b39-a280-63a146706467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:59.823274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18c721-b759-4b39-a280-63a146706467 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:59.823596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18c721-b759-4b39-a280-63a146706467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:59.823926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18c721-b759-4b39-a280-63a146706467 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:59.825112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18c721-b759-4b39-a280-63a146706467 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:59.832180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18c721-b759-4b39-a280-63a146706467 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:59.834128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 65/127] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:33:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:33:59.840113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674ed33-225a-4c37-9595-e02f26d19d8d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:59.855322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674ed33-225a-4c37-9595-e02f26d19d8d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:59.858546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1eea7-57b9-4647-9422-d2bde8b3aa36 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:59.858867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1eea7-57b9-4647-9422-d2bde8b3aa36 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:59.859153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1eea7-57b9-4647-9422-d2bde8b3aa36 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:59.861319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:59.861440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 66/128] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:33:59.862528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:59.863122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:59.863607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:59.864646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:33:59.867197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:33:59.867336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518852ed-6e3e-4c52-bef7-046f24c116df None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:59.867632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518852ed-6e3e-4c52-bef7-046f24c116df None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:59.867911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518852ed-6e3e-4c52-bef7-046f24c116df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:59.905959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-518852ed-6e3e-4c52-bef7-046f24c116df None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:33:59.905959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-518852ed-6e3e-4c52-bef7-046f24c116df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:33:59.914000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 67/129] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:33:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:33:59.938620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518852ed-6e3e-4c52-bef7-046f24c116df None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:33:59.952076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518852ed-6e3e-4c52-bef7-046f24c116df None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:33:59.956644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:33:59.957448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:33:59.957736 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:33:59.958017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:33:59.972576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 63/130] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:33:59 2022] POST /identity/v3/projects => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:33:59.975778 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:33:59.990259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:33:59.991556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 68/131] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:33:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:33:59.998264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:00.087469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a6d0-8b16-4b0c-b958-836643f1eb9c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:00.096910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:00.097700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:00.098053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:00.098394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:00.099306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:00.099678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:00.101441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:00.111397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 64/132] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:33:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:00.117349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:00.140114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57077fee-7c86-4816-ba52-c4c5ebe72f1a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:00.145222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:00.146448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:00.146965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:00.147426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] PATH_INFO: `/v3/users/0736b2990f4049aeb52018fd1ca49f2d` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:00.174954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] RBAC: Authorizing `identity:get_user(user_id=0736b2990f4049aeb52018fd1ca49f2d)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:00.177355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:00.179265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 69/133] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:00 2022] GET /identity/v3/users/0736b2990f4049aeb52018fd1ca49f2d => generated 289 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:00.184897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:00.195102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1fd76-b6c0-4b26-a3d6-a91d99c1dc53 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:00.209209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:00.210035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:00.210415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:00.210819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:00.222979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:00.224887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:00.239482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 65/134] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:00.246184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:00.265221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3759f7-783b-4770-ae7e-57a7304db71b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:00.269977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3b95c-c598-473b-b1f7-f1cb71e1f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:00.271075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b95c-c598-473b-b1f7-f1cb71e1f3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:00.271528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b95c-c598-473b-b1f7-f1cb71e1f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:00.271946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b95c-c598-473b-b1f7-f1cb71e1f3f5 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:00.273848 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3b95c-c598-473b-b1f7-f1cb71e1f3f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:00.276163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3b95c-c598-473b-b1f7-f1cb71e1f3f5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:00.278629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 70/135] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:00 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:00.284960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:00.294922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57d094-c691-478b-86ea-e9f29510e757 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:00.302844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d4ba3-9510-4df3-b19b-a5356f353c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:00.303622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4ba3-9510-4df3-b19b-a5356f353c6f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:00.304000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4ba3-9510-4df3-b19b-a5356f353c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:00.304374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d4ba3-9510-4df3-b19b-a5356f353c6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:00.305327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d4ba3-9510-4df3-b19b-a5356f353c6f admin admin] RBAC: Adding query filter params (role.id=7d0c26a4e4a64cb78fe8534e9cd46760, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=0736b2990f4049aeb52018fd1ca49f2d) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:00.305733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d4ba3-9510-4df3-b19b-a5356f353c6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:00.307760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d4ba3-9510-4df3-b19b-a5356f353c6f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:00.314100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 66/136] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:00 2022] GET /identity/v3/role_assignments?user.id=0736b2990f4049aeb52018fd1ca49f2d&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=7d0c26a4e4a64cb78fe8534e9cd46760 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:01.026297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685a10-e7e1-459f-bf8f-eda96d80588c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.027789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685a10-e7e1-459f-bf8f-eda96d80588c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.028232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685a10-e7e1-459f-bf8f-eda96d80588c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.030187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 71/137] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:01.036103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094f67-b02c-41ae-8b4f-fc79e0f401c2 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.036880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094f67-b02c-41ae-8b4f-fc79e0f401c2 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.037301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094f67-b02c-41ae-8b4f-fc79e0f401c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.058803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2f094f67-b02c-41ae-8b4f-fc79e0f401c2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:01.060264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2f094f67-b02c-41ae-8b4f-fc79e0f401c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:01.068483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 67/138] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:01.093275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9685a10-e7e1-459f-bf8f-eda96d80588c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.109132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9685a10-e7e1-459f-bf8f-eda96d80588c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.113662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.119482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.119933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.120403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.133405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:01.140715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:01.143441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 72/139] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:01.149461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f094f67-b02c-41ae-8b4f-fc79e0f401c2 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.164000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f094f67-b02c-41ae-8b4f-fc79e0f401c2 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.174886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.175571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.175854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.176131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.176916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:01.177229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.178899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.193856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 68/140] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:01.199552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.216933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292af75-500c-43a0-95b3-3c95847734a7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.229020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.230534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.230841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.231117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] PATH_INFO: `/v3/users/caa8734036c04822b77766dda26302e7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.233327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] RBAC: Authorizing `identity:get_user(user_id=caa8734036c04822b77766dda26302e7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.235278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.237064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 73/141] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/users/caa8734036c04822b77766dda26302e7 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:01.242461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.255735 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d35af-1724-4e15-b919-c06e2bb5ccfd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.262893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee86c3-9bdd-45aa-a010-317f75dd6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.263553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee86c3-9bdd-45aa-a010-317f75dd6815 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.263841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee86c3-9bdd-45aa-a010-317f75dd6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.264121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee86c3-9bdd-45aa-a010-317f75dd6815 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.279035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee86c3-9bdd-45aa-a010-317f75dd6815 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.280724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee86c3-9bdd-45aa-a010-317f75dd6815 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.296825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 69/142] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:01.302533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.317211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54117de-441e-469c-94ed-69bdba64e10d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.317487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284ca8-6206-4362-9f61-6d95b86c06c7 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.317875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284ca8-6206-4362-9f61-6d95b86c06c7 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.318071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284ca8-6206-4362-9f61-6d95b86c06c7 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.319884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 70/143] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:01.321986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.322876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.323162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.323463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.325843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.326603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59948-0edf-460d-bb45-50fdff8dcafa None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.326948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59948-0edf-460d-bb45-50fdff8dcafa None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.327230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a59948-0edf-460d-bb45-50fdff8dcafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.327980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.329786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 74/144] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:01.344124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.358621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ea8fb-d87e-45b4-8b83-97b1fd3eb6d0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.377234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.377897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.378178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.378456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.379345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=caa8734036c04822b77766dda26302e7) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:01.379652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.379811 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-94a59948-0edf-460d-bb45-50fdff8dcafa None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:01.380917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-94a59948-0edf-460d-bb45-50fdff8dcafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:01.381509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.394401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 75/145] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/role_assignments?user.id=caa8734036c04822b77766dda26302e7&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:01.398659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 71/146] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:01.460486 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.471241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d527c98-7538-4476-a449-24bdad1ffdf5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.482717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.483546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.483831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.484106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.498159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:01.505040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:01.506276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 76/147] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:01.512843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a59948-0edf-460d-bb45-50fdff8dcafa None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.525845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a59948-0edf-460d-bb45-50fdff8dcafa None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.540457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.541054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.541341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.541617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.542457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:01.542799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.544556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.560194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 72/148] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:01.566965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.576790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2beb-da5c-4a59-9c4f-285b9fa0c1c0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.591382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.592276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.592557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.592833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.599689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.601917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.603678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 77/149] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:01.609172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.622428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3b363-ce12-4ca8-9ee6-6dc7548fe1f9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.629513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.630208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.630543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.630856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.646608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.648586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.663737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 73/150] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:01.669405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.680961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccd1cd-8067-4ba2-82dc-38b4c46175fa admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.691210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c36bc-19ad-44a2-84fd-cc2335b776f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.692086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c36bc-19ad-44a2-84fd-cc2335b776f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.692368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c36bc-19ad-44a2-84fd-cc2335b776f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.692636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c36bc-19ad-44a2-84fd-cc2335b776f7 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.699723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c36bc-19ad-44a2-84fd-cc2335b776f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.701794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c36bc-19ad-44a2-84fd-cc2335b776f7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.703878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 78/151] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:01.709627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:01.720531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c357-6ba6-4f55-aeb6-63b9d3894991 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:01.727320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17d84f-8e24-4acf-8045-96b1d59fca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:01.728214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17d84f-8e24-4acf-8045-96b1d59fca3b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:01.728789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17d84f-8e24-4acf-8045-96b1d59fca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:01.729275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17d84f-8e24-4acf-8045-96b1d59fca3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:01.730357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17d84f-8e24-4acf-8045-96b1d59fca3b admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=2ce7244afa9e4badaf5a397a60aa4c51) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:01.730915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17d84f-8e24-4acf-8045-96b1d59fca3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:01.733031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17d84f-8e24-4acf-8045-96b1d59fca3b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:01.742741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 74/152] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:01 2022] GET /identity/v3/role_assignments?user.id=2ce7244afa9e4badaf5a397a60aa4c51&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=195819215583470b80fa053d7de42a6c => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:02.424045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81929060-dda5-47c2-96ee-6b56a37e3d9f None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.425020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81929060-dda5-47c2-96ee-6b56a37e3d9f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.425487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81929060-dda5-47c2-96ee-6b56a37e3d9f None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.427500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 79/153] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:02.434126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6aa77-8e6a-44b5-848b-d0c83254366c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.434611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6aa77-8e6a-44b5-848b-d0c83254366c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.434700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6aa77-8e6a-44b5-848b-d0c83254366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.455130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a6b6aa77-8e6a-44b5-848b-d0c83254366c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:02.456793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a6b6aa77-8e6a-44b5-848b-d0c83254366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:02.464880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 75/154] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:02.490691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81929060-dda5-47c2-96ee-6b56a37e3d9f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.512204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81929060-dda5-47c2-96ee-6b56a37e3d9f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.520283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323ebab-07a3-4a6a-8468-05a7c5dd7128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.521082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323ebab-07a3-4a6a-8468-05a7c5dd7128 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.521358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323ebab-07a3-4a6a-8468-05a7c5dd7128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.521624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323ebab-07a3-4a6a-8468-05a7c5dd7128 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.536664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323ebab-07a3-4a6a-8468-05a7c5dd7128 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:02.544280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-4323ebab-07a3-4a6a-8468-05a7c5dd7128 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:02.545496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 80/155] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:02.551364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6aa77-8e6a-44b5-848b-d0c83254366c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.559084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990ed54-3281-483f-babc-81a4faa1abee None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.563541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990ed54-3281-483f-babc-81a4faa1abee None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.563541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990ed54-3281-483f-babc-81a4faa1abee None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.563541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 81/156] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:02.563767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6aa77-8e6a-44b5-848b-d0c83254366c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.569730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c51162-6e2f-4e66-a5ce-c5bb44920edf None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.569980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c51162-6e2f-4e66-a5ce-c5bb44920edf None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.570254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c51162-6e2f-4e66-a5ce-c5bb44920edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.572482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.573375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.573852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.574326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.575321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:02.575813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.578908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.589748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 76/157] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:02.594828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-97c51162-6e2f-4e66-a5ce-c5bb44920edf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:02.594828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-97c51162-6e2f-4e66-a5ce-c5bb44920edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:02.596450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.601874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 82/158] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:02.610451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533a1a-e952-4165-bc5c-72beab2c4b4d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.615461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.616612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.617117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.617579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.619093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.621634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.623487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 77/159] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:02.627752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c51162-6e2f-4e66-a5ce-c5bb44920edf None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.631671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.637298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c51162-6e2f-4e66-a5ce-c5bb44920edf None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.642789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.644079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.644632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.645074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.646648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd88930-3f04-46a2-a6b1-7b3c76239791 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.652773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.653439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.653729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.654016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.659660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:02.663883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.665703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.670035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:02.672304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 83/160] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:02.677905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.678246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 78/161] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:02.683922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.688195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743223e0-8a70-4ea1-a505-3b0991f30225 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.692907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.693769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.694243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.694506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdd68-b73a-45c9-9228-32d93d8806cd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.694903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.696147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:02.696703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.699066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.699616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.700651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.701198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.701584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] PATH_INFO: `/v3/projects/7b3b3473ad92488caaf1e521716529c2` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.703313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] RBAC: Authorizing `identity:get_project(project_id=7b3b3473ad92488caaf1e521716529c2)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.705643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.708666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 79/162] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/projects/7b3b3473ad92488caaf1e521716529c2 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:02.709827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 84/163] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:02.715622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.715936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.726019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a59dd0-051a-4477-8af4-292c29f8899e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.727263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3183f9c-d1e3-4a2c-bd64-b4362f2d0868 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.732511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.732797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.733310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.733666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.734016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.734390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.734919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.735061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, scope.project.id=7b3b3473ad92488caaf1e521716529c2, user.id=2ce7244afa9e4badaf5a397a60aa4c51) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:02.735471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.735733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] PATH_INFO: `/v3/users/2ce7244afa9e4badaf5a397a60aa4c51` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.737107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ce7244afa9e4badaf5a397a60aa4c51)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.737563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.739792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.741728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 85/164] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/users/2ce7244afa9e4badaf5a397a60aa4c51 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:02.746063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 80/165] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/role_assignments?user.id=2ce7244afa9e4badaf5a397a60aa4c51&scope.project.id=7b3b3473ad92488caaf1e521716529c2&role.id=195819215583470b80fa053d7de42a6c => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:02.748034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.759126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7164d5-040b-428d-a3ab-e9b2569bf812 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.764751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.765816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.766309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.766845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.777257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.779517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.790485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 86/166] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:02.797330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.808232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeb237-8e88-4c27-8792-1f08cd7298b6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.813473 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252f3bc-d91b-4a58-a8e6-75b79f2e1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.814721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252f3bc-d91b-4a58-a8e6-75b79f2e1a0e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.815295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252f3bc-d91b-4a58-a8e6-75b79f2e1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.815771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252f3bc-d91b-4a58-a8e6-75b79f2e1a0e admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.817457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252f3bc-d91b-4a58-a8e6-75b79f2e1a0e admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.819992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252f3bc-d91b-4a58-a8e6-75b79f2e1a0e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.822079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 81/167] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:02.828385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:02.838137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3869c-3c86-4c9a-a403-fc49228e082b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:02.843777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ad0d-b19c-45c2-a77e-35978a1f0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:02.844913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ad0d-b19c-45c2-a77e-35978a1f0f22 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:02.845402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ad0d-b19c-45c2-a77e-35978a1f0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:02.845869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ad0d-b19c-45c2-a77e-35978a1f0f22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:02.847010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ad0d-b19c-45c2-a77e-35978a1f0f22 admin admin] RBAC: Adding query filter params (role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=2ce7244afa9e4badaf5a397a60aa4c51) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:02.847603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ad0d-b19c-45c2-a77e-35978a1f0f22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:02.849894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ad0d-b19c-45c2-a77e-35978a1f0f22 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:02.857823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 87/168] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:02 2022] GET /identity/v3/role_assignments?user.id=2ce7244afa9e4badaf5a397a60aa4c51&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:03.119374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805242-5e4d-4bc6-9637-0fef83e8e6f3 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.119661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805242-5e4d-4bc6-9637-0fef83e8e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.119938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805242-5e4d-4bc6-9637-0fef83e8e6f3 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.121774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 82/169] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:03.127121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1d16-2bac-40f4-9e20-fe5ec142419e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.127407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1d16-2bac-40f4-9e20-fe5ec142419e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.127680 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1d16-2bac-40f4-9e20-fe5ec142419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.145657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-65ee1d16-2bac-40f4-9e20-fe5ec142419e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:03.146841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-65ee1d16-2bac-40f4-9e20-fe5ec142419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:03.155328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 88/170] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:03.179736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68805242-5e4d-4bc6-9637-0fef83e8e6f3 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:03.192321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68805242-5e4d-4bc6-9637-0fef83e8e6f3 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:03.196634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403def7-11b3-4c48-b8ae-a710168b8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:03.197414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403def7-11b3-4c48-b8ae-a710168b8c61 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.197696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403def7-11b3-4c48-b8ae-a710168b8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.197973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403def7-11b3-4c48-b8ae-a710168b8c61 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.199838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403def7-11b3-4c48-b8ae-a710168b8c61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:03.201538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403def7-11b3-4c48-b8ae-a710168b8c61 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:03.203164 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 83/171] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:03.208495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee1d16-2bac-40f4-9e20-fe5ec142419e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:03.218214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee1d16-2bac-40f4-9e20-fe5ec142419e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:03.222463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:03.223176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.223456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.223723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.224459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:03.225481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:03.225481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:03.225481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:03.226673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:03.270183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e66db2-d720-49ef-bb5d-ae140819b70d None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.270495 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e66db2-d720-49ef-bb5d-ae140819b70d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.270806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e66db2-d720-49ef-bb5d-ae140819b70d None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.272605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 84/172] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:03.278142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc2de-9449-4cfe-9d74-549bbcc8ac2f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.278422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc2de-9449-4cfe-9d74-549bbcc8ac2f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.278697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc2de-9449-4cfe-9d74-549bbcc8ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.296691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b2adc2de-9449-4cfe-9d74-549bbcc8ac2f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:03.297907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b2adc2de-9449-4cfe-9d74-549bbcc8ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:03.305309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 85/173] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:03.328779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc2de-9449-4cfe-9d74-549bbcc8ac2f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:03.337767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc2de-9449-4cfe-9d74-549bbcc8ac2f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:03.338616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 89/174] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:03 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:03.342245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:03.343192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.343353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.343617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.356446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:03.363685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:03.365023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 86/175] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:03.371791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:03.381694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b74e1-90e8-496d-b6f6-e373b7e3b99c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:03.386704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:03.387412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.387687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.387955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.388731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:03.389027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:03.390716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:03.400168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 90/176] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:03.405982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:03.417854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7aff8-fff7-455b-93cf-c92a774718b6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:03.422283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:03.423731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.423731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.423731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] PATH_INFO: `/v3/users/0736b2990f4049aeb52018fd1ca49f2d` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.425015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] RBAC: Authorizing `identity:get_user(user_id=0736b2990f4049aeb52018fd1ca49f2d)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:03.427333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:03.429131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 87/177] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:03 2022] GET /identity/v3/users/0736b2990f4049aeb52018fd1ca49f2d => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:03.435621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:03.445998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376998e7-6717-443e-ab02-4834f3d55dbb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:03.451512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1902db-9aed-4876-81e0-cf32235a37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:03.452487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1902db-9aed-4876-81e0-cf32235a37c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.452768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1902db-9aed-4876-81e0-cf32235a37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.453038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1902db-9aed-4876-81e0-cf32235a37c0 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.454281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1902db-9aed-4876-81e0-cf32235a37c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:03.456801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1902db-9aed-4876-81e0-cf32235a37c0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:03.458563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 91/178] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:03 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:03.464493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:03.474915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe12b-5cb3-4919-9dbf-9467a8a59d05 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:03.479299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff69558-d04f-4bde-a169-546b28692539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:03.480343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69558-d04f-4bde-a169-546b28692539 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:03.480622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69558-d04f-4bde-a169-546b28692539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:03.480894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69558-d04f-4bde-a169-546b28692539 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/0736b2990f4049aeb52018fd1ca49f2d/roles/7d0c26a4e4a64cb78fe8534e9cd46760` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:03.482948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff69558-d04f-4bde-a169-546b28692539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd, user_id=0736b2990f4049aeb52018fd1ca49f2d, role_id=7d0c26a4e4a64cb78fe8534e9cd46760)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:03.485677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff69558-d04f-4bde-a169-546b28692539 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:03.624776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 88/179] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:03 2022] PUT /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/users/0736b2990f4049aeb52018fd1ca49f2d/roles/7d0c26a4e4a64cb78fe8534e9cd46760 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:05.708164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f59c5-4ff6-45a3-807b-8f8ce623c973 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.708669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f59c5-4ff6-45a3-807b-8f8ce623c973 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.708742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f59c5-4ff6-45a3-807b-8f8ce623c973 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.710760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 92/180] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:05.716429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcc35f-0277-48ae-b89c-8c90de51dcaf None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.716869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcc35f-0277-48ae-b89c-8c90de51dcaf None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.717042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcc35f-0277-48ae-b89c-8c90de51dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.738941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-fadcc35f-0277-48ae-b89c-8c90de51dcaf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:05.740135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fadcc35f-0277-48ae-b89c-8c90de51dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:05.802076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 89/181] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:05.821375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e081b1-b757-439d-bc47-533c091a9572 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.821687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e081b1-b757-439d-bc47-533c091a9572 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.821914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e081b1-b757-439d-bc47-533c091a9572 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.824361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 93/182] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:05.828007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcc35f-0277-48ae-b89c-8c90de51dcaf None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:05.829584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05481-e881-449f-888a-f513f09e185b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.829871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05481-e881-449f-888a-f513f09e185b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.830145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05481-e881-449f-888a-f513f09e185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.837379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcc35f-0277-48ae-b89c-8c90de51dcaf None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:05.841942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:05.842761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.843040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.843312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.851585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-94e05481-e881-449f-888a-f513f09e185b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:05.853358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-94e05481-e881-449f-888a-f513f09e185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:05.856909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:05.862057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 94/183] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:05.870773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:05.870773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 90/184] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:05.876302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:05.876734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc34b-6a37-401c-895d-0c454c5fbedd None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.876991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc34b-6a37-401c-895d-0c454c5fbedd None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.877268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc34b-6a37-401c-895d-0c454c5fbedd None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.879082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 95/185] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:05.884310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bef89-11d5-4bc9-95ef-c855e592b9cf None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.884755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bef89-11d5-4bc9-95ef-c855e592b9cf None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.885173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bef89-11d5-4bc9-95ef-c855e592b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.886834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6561b5-6ae7-44bf-a660-623c0f0e6814 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:05.891418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:05.892081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.892370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.892708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.893498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:05.894590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:05.895654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:05.904829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 91/186] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:05.905049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7e8bef89-11d5-4bc9-95ef-c855e592b9cf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:05.905477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:05.906217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7e8bef89-11d5-4bc9-95ef-c855e592b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:05.915030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 96/187] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:05.918977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bef89-11d5-4bc9-95ef-c855e592b9cf None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:05.920137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23a2b-003c-4870-beba-6f3250403775 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:05.924586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:05.925382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.925661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.925937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.931369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bef89-11d5-4bc9-95ef-c855e592b9cf None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:05.937023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:05.937636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:05.938761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.939235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.939692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] PATH_INFO: `/v3/users/4b48db356f7f4b2487a5b0f31935f041` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.944383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:05.945942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 92/188] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:05.946351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:05.956095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] RBAC: Authorizing `identity:get_user(user_id=4b48db356f7f4b2487a5b0f31935f041)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:05.958588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:05.959338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b35243-342e-4c95-b6b6-7f48d49683e4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:05.960338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 97/189] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:05 2022] GET /identity/v3/users/4b48db356f7f4b2487a5b0f31935f041 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:05.961188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:05.964380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:05.965361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.965639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.965907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.967379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:05.969063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:05.974713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 93/190] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:05.974713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:05.974978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f1fb7-b364-4d5d-95db-b653739e491a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:05.977018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:05.977679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.977959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.978230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.979028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:05.979334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:05.981439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:05.981941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73db2-922f-4d2f-9e9b-7cb0f30e152e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:05.986333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:05.987044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:05.987264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:05.987537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:05.990032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 98/191] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:05.990616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.000619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341bfc-a7b4-4e0c-bbaf-6255d1f95332 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.001525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.003314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.005227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.005875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.006158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.006432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.007187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.009077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.017547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 94/192] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:06.017547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.027532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58701fc-554e-4e82-a96b-8dd2aa14c21d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.032058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.032672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.032946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.033212 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] PATH_INFO: `/v3/users/4b48db356f7f4b2487a5b0f31935f041` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.034659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b48db356f7f4b2487a5b0f31935f041)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.037036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.038607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 95/193] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/users/4b48db356f7f4b2487a5b0f31935f041 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.039383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.049250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429d1d1-7875-4f39-a26d-ffd35d2e6f99 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.053507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ed0de-7545-4a92-a21d-abd50dde5d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.054283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed0de-7545-4a92-a21d-abd50dde5d84 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.054555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed0de-7545-4a92-a21d-abd50dde5d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.054854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed0de-7545-4a92-a21d-abd50dde5d84 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.055995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ed0de-7545-4a92-a21d-abd50dde5d84 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.058545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ed0de-7545-4a92-a21d-abd50dde5d84 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.060173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 96/194] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.061277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9715f93-e391-4584-b721-b306cbbddc20 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.061553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9715f93-e391-4584-b721-b306cbbddc20 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.061826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9715f93-e391-4584-b721-b306cbbddc20 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.063447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 97/195] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:06.064127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9715f93-e391-4584-b721-b306cbbddc20 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.075546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9715f93-e391-4584-b721-b306cbbddc20 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.079984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02542bbe-2c75-4ced-9de0-fec3483fb987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.080589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02542bbe-2c75-4ced-9de0-fec3483fb987 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.080868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02542bbe-2c75-4ced-9de0-fec3483fb987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.081139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02542bbe-2c75-4ced-9de0-fec3483fb987 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.089264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02542bbe-2c75-4ced-9de0-fec3483fb987 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.091087 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02542bbe-2c75-4ced-9de0-fec3483fb987 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.099830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 98/196] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:06.101970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879958-5a56-4024-b9be-1d96bdafcc65 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.102257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879958-5a56-4024-b9be-1d96bdafcc65 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.102527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879958-5a56-4024-b9be-1d96bdafcc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.105028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 99/197] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:05 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:06.105028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.118525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0ec0-6f44-4fc6-bea1-e50f8190767c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.123857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.124209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c6879958-5a56-4024-b9be-1d96bdafcc65 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:06.124533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.124814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.125090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.125454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c6879958-5a56-4024-b9be-1d96bdafcc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:06.125966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=4b48db356f7f4b2487a5b0f31935f041) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:06.126276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.128207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.134809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 100/199] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/role_assignments?user.id=4b48db356f7f4b2487a5b0f31935f041&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.134991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 99/199] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:06.144141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.157053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d760e-aaab-4bbc-9604-8b8e48cf6fd6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.159907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879958-5a56-4024-b9be-1d96bdafcc65 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.162599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.163648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.163935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.164478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.165871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.168918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.171285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 101/200] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.178448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879958-5a56-4024-b9be-1d96bdafcc65 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.180001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.186942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.188242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.188762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.189235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.191349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305374a-b359-4b0d-b726-1cde0742c58d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.197311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.197993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.201403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.201403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.201403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] RBAC: Adding query filter params (role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=4b48db356f7f4b2487a5b0f31935f041) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:06.201403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.202316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.209292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:06.209741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 102/201] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/role_assignments?user.id=4b48db356f7f4b2487a5b0f31935f041&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.222468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:06.223984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 100/202] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:06.232000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.243404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63a087-1cf2-491b-8462-1de0fe3e6544 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.249191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.250524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.251324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.252030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.253163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:06.253770 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.255854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.267883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 103/203] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.274065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.285612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e91a4-de0d-4c30-8c64-589b037bd8f6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.290998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.292430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.292958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.293433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] PATH_INFO: `/v3/users/0736b2990f4049aeb52018fd1ca49f2d` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.295303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0736b2990f4049aeb52018fd1ca49f2d)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.298130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.300029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 101/204] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/users/0736b2990f4049aeb52018fd1ca49f2d => generated 289 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.305931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.316964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fca648-714f-4069-8000-aec167099998 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.322315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.324025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.324314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.324584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.336913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.339611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.349564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 104/205] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:06.355189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.369702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0060f-92cc-4f1b-8b55-5de29f3e2cd0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.375785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cfb15-7b65-4e98-8a93-d1504c880491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.376675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cfb15-7b65-4e98-8a93-d1504c880491 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.376960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cfb15-7b65-4e98-8a93-d1504c880491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.377234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cfb15-7b65-4e98-8a93-d1504c880491 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.378577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cfb15-7b65-4e98-8a93-d1504c880491 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.380688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cfb15-7b65-4e98-8a93-d1504c880491 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.382647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 102/206] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:06.389235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:06.398874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2d5a-c96b-459a-a79c-bbc6741607e6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:06.405024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f297a-f4f2-41f9-9987-40cdfdbe9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:06.405703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f297a-f4f2-41f9-9987-40cdfdbe9f1f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:06.405981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f297a-f4f2-41f9-9987-40cdfdbe9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:06.406247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f297a-f4f2-41f9-9987-40cdfdbe9f1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:06.407130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f297a-f4f2-41f9-9987-40cdfdbe9f1f admin admin] RBAC: Adding query filter params (role.id=7d0c26a4e4a64cb78fe8534e9cd46760, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd, user.id=0736b2990f4049aeb52018fd1ca49f2d) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:06.407432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f297a-f4f2-41f9-9987-40cdfdbe9f1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:06.409545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f297a-f4f2-41f9-9987-40cdfdbe9f1f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:06.416911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 105/207] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:06 2022] GET /identity/v3/role_assignments?user.id=0736b2990f4049aeb52018fd1ca49f2d&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=7d0c26a4e4a64cb78fe8534e9cd46760 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:08.465889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb70dd-a5d3-4460-b221-52f3dfa3eca0 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.466939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb70dd-a5d3-4460-b221-52f3dfa3eca0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.467447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb70dd-a5d3-4460-b221-52f3dfa3eca0 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.469582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 103/208] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:08.475863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e00d-5dbb-4d7d-a824-916b26a260d5 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.476395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e00d-5dbb-4d7d-a824-916b26a260d5 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.476395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e00d-5dbb-4d7d-a824-916b26a260d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.495542 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4f27e00d-5dbb-4d7d-a824-916b26a260d5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:08.496781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4f27e00d-5dbb-4d7d-a824-916b26a260d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:08.504828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 106/209] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:08.528930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb70dd-a5d3-4460-b221-52f3dfa3eca0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.541516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb70dd-a5d3-4460-b221-52f3dfa3eca0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.546249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.547074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.547351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.547622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.558951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:08.565828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:08.565968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab98d5-4d73-4f85-a2ed-0810f03bac6c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.566170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab98d5-4d73-4f85-a2ed-0810f03bac6c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.566435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab98d5-4d73-4f85-a2ed-0810f03bac6c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.567350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 104/210] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:08.568437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 107/211] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:08.573969 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.574997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39063-e9c1-46ea-a8d2-f763c6e2ea3c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.575288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39063-e9c1-46ea-a8d2-f763c6e2ea3c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.575565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39063-e9c1-46ea-a8d2-f763c6e2ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.583929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3939a-0b92-42c2-aa65-2ed6e24682cb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.590719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.591402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.591716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.591954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.592723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:08.593086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.594826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.595673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-63b39063-e9c1-46ea-a8d2-f763c6e2ea3c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:08.597036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-63b39063-e9c1-46ea-a8d2-f763c6e2ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:08.604888 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 108/212] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:08.605040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 105/213] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:08.611339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.620736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae04354-7eca-4704-b9e5-3643a8aae558 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.625009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.625908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.626187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.626460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] PATH_INFO: `/v3/users/4b48db356f7f4b2487a5b0f31935f041` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.627690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b48db356f7f4b2487a5b0f31935f041)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.629463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39063-e9c1-46ea-a8d2-f763c6e2ea3c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.629935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.631845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 106/214] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/users/4b48db356f7f4b2487a5b0f31935f041 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:08.637822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.639922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39063-e9c1-46ea-a8d2-f763c6e2ea3c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.645872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.646673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.647673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.647944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.652016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132d95f-18cf-482e-9a03-cb2fa3890af0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.657253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.658106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.658645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.658948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.660323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.662744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.664093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:08.665038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 107/215] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:08.671971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:08.672601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.673731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 109/216] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:08.679639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.684745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ac4ab-b507-45d9-b841-0e49a7982fa0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.690126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.691668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.692147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.692644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/4b48db356f7f4b2487a5b0f31935f041/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.693273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc97ae-ee24-4a43-b674-f41f0a490714 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.695209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba5562a3f2468fafae342c0ce4fde7, user_id=4b48db356f7f4b2487a5b0f31935f041, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.697915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe5d7a-4b60-499f-bd0e-c95ff0c7dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.699160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5d7a-4b60-499f-bd0e-c95ff0c7dba7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.699445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5d7a-4b60-499f-bd0e-c95ff0c7dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.699707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.699804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5d7a-4b60-499f-bd0e-c95ff0c7dba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.700479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe5d7a-4b60-499f-bd0e-c95ff0c7dba7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:08.700782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe5d7a-4b60-499f-bd0e-c95ff0c7dba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.702474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe5d7a-4b60-499f-bd0e-c95ff0c7dba7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.712196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 110/217] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:08.717862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3151a-0992-4c4b-8014-d5443ed2a253 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.722425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3151a-0992-4c4b-8014-d5443ed2a253 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.722425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3151a-0992-4c4b-8014-d5443ed2a253 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.722425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 111/218] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:08.722425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadca4-6748-4682-8840-fdc7aa5b273b None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.722425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadca4-6748-4682-8840-fdc7aa5b273b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.722425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dadca4-6748-4682-8840-fdc7aa5b273b None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.723403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 112/219] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:08.724174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dadca4-6748-4682-8840-fdc7aa5b273b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.736506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dadca4-6748-4682-8840-fdc7aa5b273b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.740703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b91414-1020-4d25-8ca9-223c596cfa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.741542 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91414-1020-4d25-8ca9-223c596cfa37 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.741815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91414-1020-4d25-8ca9-223c596cfa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.742086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91414-1020-4d25-8ca9-223c596cfa37 admin admin] PATH_INFO: `/v3/users/4b48db356f7f4b2487a5b0f31935f041` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.743294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b91414-1020-4d25-8ca9-223c596cfa37 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b48db356f7f4b2487a5b0f31935f041)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.745943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b91414-1020-4d25-8ca9-223c596cfa37 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.747513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 113/220] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/users/4b48db356f7f4b2487a5b0f31935f041 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:08.748733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e01a7-4a3a-46d0-9602-f76fcb82a251 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.749019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e01a7-4a3a-46d0-9602-f76fcb82a251 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.749295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e01a7-4a3a-46d0-9602-f76fcb82a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.766978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e28e01a7-4a3a-46d0-9602-f76fcb82a251 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:08.768155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e28e01a7-4a3a-46d0-9602-f76fcb82a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:08.775653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 114/221] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:08.776975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55764c-5178-4a0c-9970-4d103cc338a8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.777310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55764c-5178-4a0c-9970-4d103cc338a8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.777526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55764c-5178-4a0c-9970-4d103cc338a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.794560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7f55764c-5178-4a0c-9970-4d103cc338a8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:08.795740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7f55764c-5178-4a0c-9970-4d103cc338a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:08.803281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 115/222] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:08.804098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55764c-5178-4a0c-9970-4d103cc338a8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.813662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55764c-5178-4a0c-9970-4d103cc338a8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.818026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.818870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.819153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.819428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.820604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.822716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.824936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 116/223] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:08.825669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.835365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 108/224] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:08 2022] PUT /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/4b48db356f7f4b2487a5b0f31935f041/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:08.836178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.839696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9105-19b7-42b9-bccf-aeb46de3c9c9 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.901310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21176dd-db58-4da1-b473-03942c4eb25b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.906029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.906882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.907161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.907539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.910362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.911835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.911835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.912366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.913838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.916510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.918636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 117/225] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:08.923993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:08.924160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.931059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:08.934154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 109/226] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:08.934154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:08.936968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577958-29c7-4ac2-853d-2f6c9cbe9d84 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.942048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.943079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.943359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.943633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/4b48db356f7f4b2487a5b0f31935f041/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.945439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2081e-6572-41dc-9ee8-4410a145f297 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:08.945902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba5562a3f2468fafae342c0ce4fde7, user_id=4b48db356f7f4b2487a5b0f31935f041, role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.948802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:08.950505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:08.951659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:08.952526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:08.953116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:08.953884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:08.955983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:09.059192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 118/227] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:08 2022] PUT /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/4b48db356f7f4b2487a5b0f31935f041/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:09.060013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:09.121756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 110/228] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:08 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:09.134684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7306f3-e428-428f-b7d2-e40b11718176 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:09.140681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:09.141693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:09.142104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:09.142480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:09.143460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] RBAC: Adding query filter params (name=member) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:09.143874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:09.145826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:09.156834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 119/229] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:09.163242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:09.175099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36fc6e-2e71-4260-a53e-7bf7498321a0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:09.180171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:09.181291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:09.181690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:09.182012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] PATH_INFO: `/v3/users/7c9d82036b26474b951931ba2e93a1e9` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:09.201060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] RBAC: Authorizing `identity:get_user(user_id=7c9d82036b26474b951931ba2e93a1e9)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:09.204218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:09.206625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 111/230] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:09 2022] GET /identity/v3/users/7c9d82036b26474b951931ba2e93a1e9 => generated 297 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:09.213885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:09.233858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d7fe-c86b-4f71-8d21-8204c69c504c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:09.253950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:09.254767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:09.255064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:09.255355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:09.268094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:09.269957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:09.282237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 120/231] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:09.290753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:09.309275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeda13e-0e95-4a41-a3a3-7fe4af636c3a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:09.313811 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b8fab-e64d-4055-a8fe-23b690be79bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:09.314785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8fab-e64d-4055-a8fe-23b690be79bc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:09.315122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8fab-e64d-4055-a8fe-23b690be79bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:09.315385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8fab-e64d-4055-a8fe-23b690be79bc admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:09.317401 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b8fab-e64d-4055-a8fe-23b690be79bc admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:09.319499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b8fab-e64d-4055-a8fe-23b690be79bc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:09.321709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 112/232] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:09 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:09.329109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:09.346757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc2c3-b783-416e-9701-5cbbf958cd0e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:09.358762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a626e9-ea6c-41e0-b697-f0e0d8558703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:09.358762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a626e9-ea6c-41e0-b697-f0e0d8558703 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:09.358762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a626e9-ea6c-41e0-b697-f0e0d8558703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:09.358762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a626e9-ea6c-41e0-b697-f0e0d8558703 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:09.359160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a626e9-ea6c-41e0-b697-f0e0d8558703 admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=7c9d82036b26474b951931ba2e93a1e9) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:09.359160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a626e9-ea6c-41e0-b697-f0e0d8558703 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:09.360655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a626e9-ea6c-41e0-b697-f0e0d8558703 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:09.373867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 121/233] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:09 2022] GET /identity/v3/role_assignments?user.id=7c9d82036b26474b951931ba2e93a1e9&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=195819215583470b80fa053d7de42a6c => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:11.243398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc38e6-d0d6-4e4e-ab79-13afdf94dbd6 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.243921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc38e6-d0d6-4e4e-ab79-13afdf94dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.243921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc38e6-d0d6-4e4e-ab79-13afdf94dbd6 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.246668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 113/234] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:11.260320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04762b-77ff-4c1a-9682-48e18da6ba56 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.260839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04762b-77ff-4c1a-9682-48e18da6ba56 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.260914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04762b-77ff-4c1a-9682-48e18da6ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.285175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6e04762b-77ff-4c1a-9682-48e18da6ba56 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:11.286366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6e04762b-77ff-4c1a-9682-48e18da6ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:11.298592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 122/235] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:11.335682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc38e6-d0d6-4e4e-ab79-13afdf94dbd6 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:11.356389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc38e6-d0d6-4e4e-ab79-13afdf94dbd6 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:11.363346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:11.364151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.364440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.364715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.384253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:11.391834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:11.393366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 114/236] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:11.399207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04762b-77ff-4c1a-9682-48e18da6ba56 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:11.412813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04762b-77ff-4c1a-9682-48e18da6ba56 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:11.427377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:11.428132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.428333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.428606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.429377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:11.429681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:11.431415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:11.444963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 123/237] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:11.450753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:11.461132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd26820-ddf5-499c-9628-5267d4ca8424 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:11.471189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:11.472082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.472363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.472645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] PATH_INFO: `/v3/users/4b48db356f7f4b2487a5b0f31935f041` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.480215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b48db356f7f4b2487a5b0f31935f041)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:11.482793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:11.484561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 115/238] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:11 2022] GET /identity/v3/users/4b48db356f7f4b2487a5b0f31935f041 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:11.490886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:11.504356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644579a8-bdda-4231-a199-f66c9c90b7e4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:11.514542 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:11.515223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.515499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.515769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.527668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:11.529435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:11.539545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 124/239] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:11.545516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:11.556481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e0dc9-c290-4561-8b34-6580c0812b59 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:11.567073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06404c-060b-4a1e-882b-fcc6402eadae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:11.584119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06404c-060b-4a1e-882b-fcc6402eadae admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.584119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06404c-060b-4a1e-882b-fcc6402eadae admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.584119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06404c-060b-4a1e-882b-fcc6402eadae admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.584119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06404c-060b-4a1e-882b-fcc6402eadae admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:11.584119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06404c-060b-4a1e-882b-fcc6402eadae admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:11.584119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 116/240] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:11 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:11.585241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:11.595172 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46cd5c-d1ae-4262-8505-555a6d9f13b8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:11.599979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351313-dc21-478c-a71a-3481a34c91d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:11.600641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351313-dc21-478c-a71a-3481a34c91d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:11.600920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351313-dc21-478c-a71a-3481a34c91d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:11.601195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351313-dc21-478c-a71a-3481a34c91d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:11.602039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351313-dc21-478c-a71a-3481a34c91d4 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=4b48db356f7f4b2487a5b0f31935f041) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:11.602349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351313-dc21-478c-a71a-3481a34c91d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:11.604230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351313-dc21-478c-a71a-3481a34c91d4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:11.615566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 125/241] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:11 2022] GET /identity/v3/role_assignments?user.id=4b48db356f7f4b2487a5b0f31935f041&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.032330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b8390-37a4-491b-be49-39992bb5d133 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.032690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b8390-37a4-491b-be49-39992bb5d133 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.032855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b8390-37a4-491b-be49-39992bb5d133 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.034927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 117/242] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:12.040513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd491bc-1a7e-49bc-b201-6df98ba503ea None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.040803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd491bc-1a7e-49bc-b201-6df98ba503ea None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.041084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd491bc-1a7e-49bc-b201-6df98ba503ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.060373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3cd491bc-1a7e-49bc-b201-6df98ba503ea None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:12.061572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3cd491bc-1a7e-49bc-b201-6df98ba503ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:12.069584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 126/243] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:12.094682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b8390-37a4-491b-be49-39992bb5d133 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.107893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b8390-37a4-491b-be49-39992bb5d133 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.112286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.113074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.113353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.113625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.121418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00622d67-78e0-4535-aae4-7850eab28cfc None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.121721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00622d67-78e0-4535-aae4-7850eab28cfc None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.121959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00622d67-78e0-4535-aae4-7850eab28cfc None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.123845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 127/244] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:12.130286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882c32-7932-44bb-8089-bdca970d8a71 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.130957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882c32-7932-44bb-8089-bdca970d8a71 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.134909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882c32-7932-44bb-8089-bdca970d8a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.135016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:12.140070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:12.141961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 118/245] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:12.147922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.157505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d5882c32-7932-44bb-8089-bdca970d8a71 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:12.159361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9619eb-49d2-4c20-9e0f-db5deb80c725 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.161503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d5882c32-7932-44bb-8089-bdca970d8a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:12.164912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.165784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.166211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.166628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.167604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:12.168053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.169793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.173544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 128/246] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:12.180153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8acf36-233a-4d06-8adb-0ac0054e91c9 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.180512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8acf36-233a-4d06-8adb-0ac0054e91c9 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.180857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8acf36-233a-4d06-8adb-0ac0054e91c9 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.186562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 129/247] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:12.190284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 119/248] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:12.194861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380bff-1773-4e2b-9a94-1edbda5c0b95 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.195351 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380bff-1773-4e2b-9a94-1edbda5c0b95 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.195799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380bff-1773-4e2b-9a94-1edbda5c0b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.198520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.209082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a4d3a-c235-41d7-b02b-a339d435ce61 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.217312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.218469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.218779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.219056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] PATH_INFO: `/v3/users/7bd5f767575a4be7a99db71a0fa5f58f` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.220373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b4380bff-1773-4e2b-9a94-1edbda5c0b95 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:12.221740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b4380bff-1773-4e2b-9a94-1edbda5c0b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:12.231620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 130/249] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:12.232544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380bff-1773-4e2b-9a94-1edbda5c0b95 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.242086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380bff-1773-4e2b-9a94-1edbda5c0b95 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.245178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] RBAC: Authorizing `identity:get_user(user_id=7bd5f767575a4be7a99db71a0fa5f58f)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.248768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.249839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.250872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.251406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.251771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.251949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 120/250] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/users/7bd5f767575a4be7a99db71a0fa5f58f => generated 297 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.256586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.264347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:12.267407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa01c0-49e2-44c7-9e6b-e4cda20af234 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.271514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:12.271706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.272323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.272605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.272777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 131/251] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:12.273589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.274875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.284172 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ae34c-f147-4dfd-a496-0da5a8695af8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.284441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.286153 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.288504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.289253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.289537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.289803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.295597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 121/252] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:34:12.296391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.305427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8de61-d8dc-4531-b313-e9b9fa42bdb8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.306229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:12.310339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.311017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.311298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.311571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.312328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:12.312633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.313622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:12.314205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.315012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 132/253] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:12.315569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.325694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609737c4-b4ee-418a-85e6-cbc0d1d0fe51 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.332733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 122/254] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.332733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.334698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.335573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.335850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.336115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.337311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.339440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.345833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 133/255] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.345833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.351171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc404-5fa1-4fed-9f5a-0e1fd838c63d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.351462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dcb91-703a-4968-9039-0f806693c1c3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.355499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.355744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.356207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.356483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.356574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.356807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.356900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.357107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] PATH_INFO: `/v3/users/4b48db356f7f4b2487a5b0f31935f041` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.357611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:12.357898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.358557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b48db356f7f4b2487a5b0f31935f041)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.359576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.360963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.362652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 134/256] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/users/4b48db356f7f4b2487a5b0f31935f041 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.367733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.375838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 123/257] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.375838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.378625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ff21b-2126-44cc-b451-9dcf5dbc8104 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.383070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7545b-6ae6-4ad4-a1fe-0275e41ac167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.383706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7545b-6ae6-4ad4-a1fe-0275e41ac167 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.383988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7545b-6ae6-4ad4-a1fe-0275e41ac167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.384262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7545b-6ae6-4ad4-a1fe-0275e41ac167 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.384685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb75e0-fcec-4f2a-957f-a6c31861e35e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.385103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7545b-6ae6-4ad4-a1fe-0275e41ac167 admin admin] RBAC: Adding query filter params (role.id=7d0c26a4e4a64cb78fe8534e9cd46760, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=7bd5f767575a4be7a99db71a0fa5f58f) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:12.385410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7545b-6ae6-4ad4-a1fe-0275e41ac167 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.387883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7545b-6ae6-4ad4-a1fe-0275e41ac167 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.389602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14ef97-aa54-42dd-8f7b-a5e8e85933d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.390235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ef97-aa54-42dd-8f7b-a5e8e85933d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.390514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ef97-aa54-42dd-8f7b-a5e8e85933d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.390809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ef97-aa54-42dd-8f7b-a5e8e85933d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.393651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 135/258] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/role_assignments?user.id=7bd5f767575a4be7a99db71a0fa5f58f&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=7d0c26a4e4a64cb78fe8534e9cd46760 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.393651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ae372-f4d7-4ed4-bc66-1b502910aba2 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.393651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ae372-f4d7-4ed4-bc66-1b502910aba2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.393651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ae372-f4d7-4ed4-bc66-1b502910aba2 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.393651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 136/259] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:12.393651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ae372-f4d7-4ed4-bc66-1b502910aba2 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.400259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14ef97-aa54-42dd-8f7b-a5e8e85933d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.402328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14ef97-aa54-42dd-8f7b-a5e8e85933d5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.413102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 124/260] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:12.414009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ae372-f4d7-4ed4-bc66-1b502910aba2 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.414408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba38ea-bb88-4601-910d-8c79cd5666aa None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.414695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba38ea-bb88-4601-910d-8c79cd5666aa None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.415002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba38ea-bb88-4601-910d-8c79cd5666aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.422454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.423361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.423634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.424812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] PATH_INFO: `/v3/users/7c9d82036b26474b951931ba2e93a1e9` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.425189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c9d82036b26474b951931ba2e93a1e9)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.427384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.429267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 137/261] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/users/7c9d82036b26474b951931ba2e93a1e9 => generated 297 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.436084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.436722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d4ba38ea-bb88-4601-910d-8c79cd5666aa None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:12.438000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d4ba38ea-bb88-4601-910d-8c79cd5666aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:12.446250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b727a3-61aa-4f43-b8c7-996c28244105 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.450784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 125/262] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:12.450784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba38ea-bb88-4601-910d-8c79cd5666aa None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.460233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba38ea-bb88-4601-910d-8c79cd5666aa None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.464932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.465745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.466380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.466785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.467076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.467176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.467478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.467873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.468909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.469665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.471219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.472758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.473351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 126/263] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.479801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.479980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 138/264] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.479980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.490151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03ec2-8760-415b-882f-38979b5e9986 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.490722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154ce6-3269-4ff7-a12c-a84a5a3efbb7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.495499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096badd2-9d6b-4d38-88b3-81fd0501881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.496451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096badd2-9d6b-4d38-88b3-81fd0501881b admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.496683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.496818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096badd2-9d6b-4d38-88b3-81fd0501881b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.496989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096badd2-9d6b-4d38-88b3-81fd0501881b admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/7c9d82036b26474b951931ba2e93a1e9/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.497970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.498486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.498942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.499066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096badd2-9d6b-4d38-88b3-81fd0501881b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba5562a3f2468fafae342c0ce4fde7, user_id=7c9d82036b26474b951931ba2e93a1e9, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.500451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.501741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096badd2-9d6b-4d38-88b3-81fd0501881b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.502758 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.505579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 127/265] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.506721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.519719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343db08-6280-44f3-8d9d-877590ce6435 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.524254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.525012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.525322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.531470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.531470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] RBAC: Adding query filter params (role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=4b48db356f7f4b2487a5b0f31935f041) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:12.531470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.531470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.535916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 128/266] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:12 2022] GET /identity/v3/role_assignments?user.id=4b48db356f7f4b2487a5b0f31935f041&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:12.539795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:12.550459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23452c-e1f5-489e-9aa7-4b94d38b406b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:12.555174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdd0d9-0688-458e-bbc1-cdf414f285c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:12.555952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd0d9-0688-458e-bbc1-cdf414f285c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:12.556297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd0d9-0688-458e-bbc1-cdf414f285c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:12.556634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdd0d9-0688-458e-bbc1-cdf414f285c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:12.557978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdd0d9-0688-458e-bbc1-cdf414f285c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:12.560108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdd0d9-0688-458e-bbc1-cdf414f285c0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:12.613330 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 139/267] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:12 2022] PUT /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/7c9d82036b26474b951931ba2e93a1e9/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:12.699461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 129/268] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:12 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:14.637200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83620-e4dd-4a07-96eb-088f44b47164 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.637760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83620-e4dd-4a07-96eb-088f44b47164 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.637760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e83620-e4dd-4a07-96eb-088f44b47164 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.639552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 140/269] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:14.645346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044fd6-a73a-493a-ada8-25d757355561 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.645849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044fd6-a73a-493a-ada8-25d757355561 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.645952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044fd6-a73a-493a-ada8-25d757355561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.671527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ef044fd6-a73a-493a-ada8-25d757355561 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:14.672767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ef044fd6-a73a-493a-ada8-25d757355561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:14.738842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 130/270] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:14.755111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83620-e4dd-4a07-96eb-088f44b47164 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:14.767548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e83620-e4dd-4a07-96eb-088f44b47164 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:14.772003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:14.772785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.773072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.773347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.785480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:14.793000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:14.794208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 141/271] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:14.800185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044fd6-a73a-493a-ada8-25d757355561 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:14.809227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044fd6-a73a-493a-ada8-25d757355561 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:14.813785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:14.814445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.814742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.815021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.815856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:14.816166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:14.817781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:14.826385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 131/272] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:14.832230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:14.843406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa61d6-8500-47c7-af23-435ee482633a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:14.848072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:14.848955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.849237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.849513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] PATH_INFO: `/v3/users/7bd5f767575a4be7a99db71a0fa5f58f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.850837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] RBAC: Authorizing `identity:get_user(user_id=7bd5f767575a4be7a99db71a0fa5f58f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:14.853019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:14.855346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 142/273] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:14 2022] GET /identity/v3/users/7bd5f767575a4be7a99db71a0fa5f58f => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:14.861421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:14.871499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19458ae-9415-454a-bd6a-b8421b6e5749 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:14.875987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b2a9-c752-4ace-9745-3d6226f113f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:14.876865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b2a9-c752-4ace-9745-3d6226f113f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.877119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b2a9-c752-4ace-9745-3d6226f113f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.877396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b2a9-c752-4ace-9745-3d6226f113f7 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.878596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b2a9-c752-4ace-9745-3d6226f113f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:14.880704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b2a9-c752-4ace-9745-3d6226f113f7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:14.882578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 132/274] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:14 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:14.888790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:14.899026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0688d9e-031d-4a16-868b-7c20c2323d3c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:14.904343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abf9f9-cd0e-4c87-92d7-9cec0993032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:14.905254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abf9f9-cd0e-4c87-92d7-9cec0993032a admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.905532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abf9f9-cd0e-4c87-92d7-9cec0993032a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.905800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abf9f9-cd0e-4c87-92d7-9cec0993032a admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/7bd5f767575a4be7a99db71a0fa5f58f/roles/7d0c26a4e4a64cb78fe8534e9cd46760` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.908242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abf9f9-cd0e-4c87-92d7-9cec0993032a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba5562a3f2468fafae342c0ce4fde7, user_id=7bd5f767575a4be7a99db71a0fa5f58f, role_id=7d0c26a4e4a64cb78fe8534e9cd46760)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:14.911011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abf9f9-cd0e-4c87-92d7-9cec0993032a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:14.919904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c895d-96db-4acd-81ac-5567aa23a84a None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.920191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c895d-96db-4acd-81ac-5567aa23a84a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.920471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c895d-96db-4acd-81ac-5567aa23a84a None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.922322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 133/275] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:14.927958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76171ece-7458-47d5-9402-26acaa8669de None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:14.928243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76171ece-7458-47d5-9402-26acaa8669de None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:14.929350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76171ece-7458-47d5-9402-26acaa8669de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:14.946383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-76171ece-7458-47d5-9402-26acaa8669de None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:14.947604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-76171ece-7458-47d5-9402-26acaa8669de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:14.956028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 134/276] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:14.979694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76171ece-7458-47d5-9402-26acaa8669de None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:14.988629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 143/277] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:14 2022] PUT /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/users/7bd5f767575a4be7a99db71a0fa5f58f/roles/7d0c26a4e4a64cb78fe8534e9cd46760 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:14.995009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76171ece-7458-47d5-9402-26acaa8669de None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.058057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.059017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.059298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.059566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.071730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:15.079396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:15.080897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 135/278] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:15.086535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.087040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d4e60-171c-4453-b28b-5d8c9729b832 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.087329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d4e60-171c-4453-b28b-5d8c9729b832 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.087612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d4e60-171c-4453-b28b-5d8c9729b832 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.092362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 144/279] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:15.097891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c15c-2c3b-4c65-829b-418e1d46f6b2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.102650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.103365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.103649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.103920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.104743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:15.105049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.106767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.108781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596e18-80e4-428a-9a4d-a6f636dbfbac None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.109066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596e18-80e4-428a-9a4d-a6f636dbfbac None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.109340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596e18-80e4-428a-9a4d-a6f636dbfbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.117907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 136/280] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:15.122301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.132401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-98596e18-80e4-428a-9a4d-a6f636dbfbac None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:15.133837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-98596e18-80e4-428a-9a4d-a6f636dbfbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:15.134458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286cfa9-5d4f-4bcf-8ba1-de1e4602cd08 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.140011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c7930-3d1e-4efc-9a6a-fd0618614b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.140820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7930-3d1e-4efc-9a6a-fd0618614b3e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.141102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7930-3d1e-4efc-9a6a-fd0618614b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.141378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7930-3d1e-4efc-9a6a-fd0618614b3e admin admin] PATH_INFO: `/v3/users/7c9d82036b26474b951931ba2e93a1e9` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.142641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c7930-3d1e-4efc-9a6a-fd0618614b3e admin admin] RBAC: Authorizing `identity:get_user(user_id=7c9d82036b26474b951931ba2e93a1e9)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.144166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 145/281] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:15.148907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c7930-3d1e-4efc-9a6a-fd0618614b3e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.149016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09fa38-ee1b-4b2c-8878-8f6f9fa244bf None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.149016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09fa38-ee1b-4b2c-8878-8f6f9fa244bf None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.149161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 137/282] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/users/7c9d82036b26474b951931ba2e93a1e9 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:15.149251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09fa38-ee1b-4b2c-8878-8f6f9fa244bf None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.149251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 146/283] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:15.154807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09fa38-ee1b-4b2c-8878-8f6f9fa244bf None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.154971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5c05a-3b78-457b-9985-665f5b8bd90e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.155139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5c05a-3b78-457b-9985-665f5b8bd90e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.155415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5c05a-3b78-457b-9985-665f5b8bd90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.168193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09fa38-ee1b-4b2c-8878-8f6f9fa244bf None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.172784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.173553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.173927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.174317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.174457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-84c5c05a-3b78-457b-9985-665f5b8bd90e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:15.175700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-84c5c05a-3b78-457b-9985-665f5b8bd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:15.183407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.184457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 138/284] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:15.185337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5c05a-3b78-457b-9985-665f5b8bd90e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.185804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.197125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 147/285] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:34:15.199694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5c05a-3b78-457b-9985-665f5b8bd90e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.204573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.205519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.206300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.206714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.206928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.215910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d752f-815a-4136-ac4c-9999eeecdf9e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.221262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.221262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.221491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.221692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.222908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.223444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:15.224944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.226796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 148/286] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:15.227638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.235288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:15.237170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 139/287] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:15.237627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48550aa2-5da6-4d8a-9281-4f464942435b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.237993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.242310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.243463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.243838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.244187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.245455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.247242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.248807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 149/288] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:15.249432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32520d30-a7f4-4d31-8924-3d229ac88d4e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.249551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.254325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.255164 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.255607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.256023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.257028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=7c9d82036b26474b951931ba2e93a1e9) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:15.257490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.259516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.259800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e329e-2481-4ac1-8b65-2335ad54570d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.264601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.265233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.265513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.265785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.266528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] RBAC: Adding query filter params (name=member) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:15.266862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.267924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 140/289] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/role_assignments?user.id=7c9d82036b26474b951931ba2e93a1e9&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=195819215583470b80fa053d7de42a6c => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:15.268422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.269123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.278545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 150/290] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:15.282180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937fbd-c635-4fd5-9a38-41946cd17fdf admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.284119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.287512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1ba3-0ef9-4634-9b28-4e82d8d5318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.288255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1ba3-0ef9-4634-9b28-4e82d8d5318a admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.288533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1ba3-0ef9-4634-9b28-4e82d8d5318a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.288804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1ba3-0ef9-4634-9b28-4e82d8d5318a admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.289599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1ba3-0ef9-4634-9b28-4e82d8d5318a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.291905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1ba3-0ef9-4634-9b28-4e82d8d5318a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.296973 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe32d5-d203-4dde-805b-1455202030fe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.303844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.305243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.305646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.305998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] PATH_INFO: `/v3/users/bb24aaaed2784aaeba25d976ad353a8f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.321955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] RBAC: Authorizing `identity:get_user(user_id=bb24aaaed2784aaeba25d976ad353a8f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.324822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.327024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 151/291] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/users/bb24aaaed2784aaeba25d976ad353a8f => generated 293 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:15.334886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:15.344922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ef237-7a82-4687-8144-bc9cdb547c7e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:15.349681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312a5fd-626a-4b1f-8cca-2e3cec4734bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:15.350473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312a5fd-626a-4b1f-8cca-2e3cec4734bb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:15.350886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312a5fd-626a-4b1f-8cca-2e3cec4734bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:15.351253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312a5fd-626a-4b1f-8cca-2e3cec4734bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:15.352227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312a5fd-626a-4b1f-8cca-2e3cec4734bb admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, user.id=bb24aaaed2784aaeba25d976ad353a8f, scope.system=all) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:15.352631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312a5fd-626a-4b1f-8cca-2e3cec4734bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:15.354646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312a5fd-626a-4b1f-8cca-2e3cec4734bb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:15.370861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 152/292] 10.222.0.88 () {56 vars in 1329 bytes} [Mon Jan 17 09:34:15 2022] GET /identity/v3/role_assignments?user.id=bb24aaaed2784aaeba25d976ad353a8f&scope.system=all&role.id=195819215583470b80fa053d7de42a6c => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:15.409660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 141/293] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:15 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:17.243557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcd16-a8e1-4772-ae0d-39ad31d8968c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.244079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcd16-a8e1-4772-ae0d-39ad31d8968c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.244384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcd16-a8e1-4772-ae0d-39ad31d8968c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.246896 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 153/294] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:17.252394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1532-1ec1-4119-a9d3-070fb06caab6 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.252839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1532-1ec1-4119-a9d3-070fb06caab6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.253152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1532-1ec1-4119-a9d3-070fb06caab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.271580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-bbbd1532-1ec1-4119-a9d3-070fb06caab6 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:17.272922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-bbbd1532-1ec1-4119-a9d3-070fb06caab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:17.281028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 142/295] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:17.305860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcd16-a8e1-4772-ae0d-39ad31d8968c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.318858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcd16-a8e1-4772-ae0d-39ad31d8968c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.323376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.324290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.324673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.325049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.337768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:17.345371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:17.346768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 154/296] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:17.356960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1532-1ec1-4119-a9d3-070fb06caab6 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.367310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1532-1ec1-4119-a9d3-070fb06caab6 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.374176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.375208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.375676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.376160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.377140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:17.377636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.379541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.389768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 143/297] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:17.395284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.405427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5dd6-8418-478c-8876-17e0fbc93118 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.410150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.411056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.411343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.411619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] PATH_INFO: `/v3/users/7bd5f767575a4be7a99db71a0fa5f58f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.412848 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] RBAC: Authorizing `identity:get_user(user_id=7bd5f767575a4be7a99db71a0fa5f58f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.415012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.417483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 155/298] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/users/7bd5f767575a4be7a99db71a0fa5f58f => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:17.422894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.433514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ade72-19f3-4c81-8a78-fe293f0d3eeb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.438199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.438873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.439159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.439436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.448026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.449942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.459828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 144/299] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:17.465735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.477037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693d73a-7078-4e96-ba44-dfe7a4a4c116 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.482062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bf5cc-d478-4ed2-8390-3986da666cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.482955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf5cc-d478-4ed2-8390-3986da666cab admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.483241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf5cc-d478-4ed2-8390-3986da666cab admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.483509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf5cc-d478-4ed2-8390-3986da666cab admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.484733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bf5cc-d478-4ed2-8390-3986da666cab admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.486983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bf5cc-d478-4ed2-8390-3986da666cab admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.489323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 156/300] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:17.495052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.504509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c293e2-5507-4acc-ba89-24b6826087a7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.509530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea70ff4-ff89-45f3-8f41-e2ea6d2f3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.509719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea70ff4-ff89-45f3-8f41-e2ea6d2f3c1f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.509913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea70ff4-ff89-45f3-8f41-e2ea6d2f3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.510187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea70ff4-ff89-45f3-8f41-e2ea6d2f3c1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.511604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea70ff4-ff89-45f3-8f41-e2ea6d2f3c1f admin admin] RBAC: Adding query filter params (role.id=7d0c26a4e4a64cb78fe8534e9cd46760, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7, user.id=7bd5f767575a4be7a99db71a0fa5f58f) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:17.511918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea70ff4-ff89-45f3-8f41-e2ea6d2f3c1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.513763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea70ff4-ff89-45f3-8f41-e2ea6d2f3c1f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.521321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 145/301] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/role_assignments?user.id=7bd5f767575a4be7a99db71a0fa5f58f&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=7d0c26a4e4a64cb78fe8534e9cd46760 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:17.644926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6ab5-63bd-481f-bf80-c404e2449b43 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.645288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6ab5-63bd-481f-bf80-c404e2449b43 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.645488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6ab5-63bd-481f-bf80-c404e2449b43 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.647379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 157/302] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:17.653515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9a36-8b68-456f-a26d-9ef9967f95b0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.653813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9a36-8b68-456f-a26d-9ef9967f95b0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.654075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9a36-8b68-456f-a26d-9ef9967f95b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.678203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-37dd9a36-8b68-456f-a26d-9ef9967f95b0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:17.679474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-37dd9a36-8b68-456f-a26d-9ef9967f95b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:17.688247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 146/303] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:17.715147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6ab5-63bd-481f-bf80-c404e2449b43 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.730922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6ab5-63bd-481f-bf80-c404e2449b43 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.735402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.736182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.736495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.736738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.753921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:17.761481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:17.763032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 158/304] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:17.768968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd9a36-8b68-456f-a26d-9ef9967f95b0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.780467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd9a36-8b68-456f-a26d-9ef9967f95b0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.785433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f7834-d339-4992-b661-9713a00a60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.786115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f7834-d339-4992-b661-9713a00a60ac admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.786397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f7834-d339-4992-b661-9713a00a60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.786716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f7834-d339-4992-b661-9713a00a60ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.787572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f7834-d339-4992-b661-9713a00a60ac admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:17.787875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f7834-d339-4992-b661-9713a00a60ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.789529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f7834-d339-4992-b661-9713a00a60ac admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.803132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 147/305] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:17.809179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.825287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06274bd-18f2-4ecd-96b2-0d3cbfe2a115 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.829053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a24ee-320d-4090-b0ab-a393f2d12853 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.829335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a24ee-320d-4090-b0ab-a393f2d12853 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.829741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a24ee-320d-4090-b0ab-a393f2d12853 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.831848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 148/306] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:17.832667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.833196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.833475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.833792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] PATH_INFO: `/v3/users/bb24aaaed2784aaeba25d976ad353a8f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.835889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb24aaaed2784aaeba25d976ad353a8f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.836743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111504-8a25-4540-82b5-52de3b290a85 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.837026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111504-8a25-4540-82b5-52de3b290a85 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.837299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111504-8a25-4540-82b5-52de3b290a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.837681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.839519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 159/307] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/users/bb24aaaed2784aaeba25d976ad353a8f => generated 293 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:17.849266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.858170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-19111504-8a25-4540-82b5-52de3b290a85 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:17.859377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-19111504-8a25-4540-82b5-52de3b290a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:17.860177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746a1e5-dd6b-4413-8afe-ff4e45124932 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.866151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.867007 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.867289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.867571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] PATH_INFO: `/v3/system/users/bb24aaaed2784aaeba25d976ad353a8f/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.868953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 149/308] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:17.874839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bb24aaaed2784aaeba25d976ad353a8f, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.874839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:17.874839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:17.874839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:17.874839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.898701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907496b4-ff38-40cf-bf23-8dfd7a8beda6 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.899022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907496b4-ff38-40cf-bf23-8dfd7a8beda6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.899298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907496b4-ff38-40cf-bf23-8dfd7a8beda6 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.901081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 150/309] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:17.901849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907496b4-ff38-40cf-bf23-8dfd7a8beda6 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.918640 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907496b4-ff38-40cf-bf23-8dfd7a8beda6 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.922920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1d66b-b563-4209-bdfe-415312dfde7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.923714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d66b-b563-4209-bdfe-415312dfde7c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.923948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d66b-b563-4209-bdfe-415312dfde7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.924218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d66b-b563-4209-bdfe-415312dfde7c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.925373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1d66b-b563-4209-bdfe-415312dfde7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.927087 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1d66b-b563-4209-bdfe-415312dfde7c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.928642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 151/310] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:17.933550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd513a4c-be46-4a23-846e-0943fda94ce1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.933932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd513a4c-be46-4a23-846e-0943fda94ce1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.934215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd513a4c-be46-4a23-846e-0943fda94ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.955163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-bd513a4c-be46-4a23-846e-0943fda94ce1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:17.956483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-bd513a4c-be46-4a23-846e-0943fda94ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:17.964190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 152/311] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:17.965133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd513a4c-be46-4a23-846e-0943fda94ce1 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:17.967398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 160/312] 10.222.0.88 () {58 vars in 1355 bytes} [Mon Jan 17 09:34:17 2022] PUT /identity/v3/system/users/bb24aaaed2784aaeba25d976ad353a8f/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:34:17.978654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd513a4c-be46-4a23-846e-0943fda94ce1 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:17.984169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:17.985065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:17.985401 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:17.985769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] PATH_INFO: `/v3/groups` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:17.986636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:17.987855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:17.987855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:17.987855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:17.989208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:17.991383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:18.002710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f322-8e5d-4fc0-81a7-fd5b6ea4308c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:18.007460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:18.008191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:18.008587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:18.008861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:18.024393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:18.031963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:18.033485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 161/313] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:18.039677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:18.051890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d4d8-589d-4dcf-87a8-d7b8c0e84fe0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:18.056529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:18.057325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:18.058102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:18.058370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:18.059189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:18.059493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:18.061150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:18.072019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 162/314] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:18.077698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:18.085838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 153/315] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jan 17 09:34:17 2022] POST /identity/v3/groups => generated 229 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:18.092926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375d051-9e20-4062-abb6-a431387087ac admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:18.100053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768316f8-90b9-445e-a333-2ec3c862a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:18.100960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768316f8-90b9-445e-a333-2ec3c862a042 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:18.101227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768316f8-90b9-445e-a333-2ec3c862a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:18.101504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768316f8-90b9-445e-a333-2ec3c862a042 admin admin] PATH_INFO: `/v3/users/cf99b32783a846999ea0a01e2576ea58` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:18.123039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768316f8-90b9-445e-a333-2ec3c862a042 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf99b32783a846999ea0a01e2576ea58)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:18.125514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768316f8-90b9-445e-a333-2ec3c862a042 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:18.127726 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 163/316] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:18 2022] GET /identity/v3/users/cf99b32783a846999ea0a01e2576ea58 => generated 293 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:18.133965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:18.150121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cbee3-0358-4379-b380-213cac2b3e35 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:18.157739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453faf4c-2f3e-4783-986b-645851d3e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:18.159091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453faf4c-2f3e-4783-986b-645851d3e249 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:18.159511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453faf4c-2f3e-4783-986b-645851d3e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:18.159924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453faf4c-2f3e-4783-986b-645851d3e249 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:18.161282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453faf4c-2f3e-4783-986b-645851d3e249 admin admin] RBAC: Adding query filter params (role.id=7d0c26a4e4a64cb78fe8534e9cd46760, user.id=cf99b32783a846999ea0a01e2576ea58, scope.system=all) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:18.161787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453faf4c-2f3e-4783-986b-645851d3e249 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:18.165004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453faf4c-2f3e-4783-986b-645851d3e249 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:18.179394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 154/317] 10.222.0.88 () {56 vars in 1329 bytes} [Mon Jan 17 09:34:18 2022] GET /identity/v3/role_assignments?user.id=cf99b32783a846999ea0a01e2576ea58&scope.system=all&role.id=7d0c26a4e4a64cb78fe8534e9cd46760 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:20.164346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8740-e51f-4d19-877e-a21230caa491 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.164862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8740-e51f-4d19-877e-a21230caa491 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.164862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8740-e51f-4d19-877e-a21230caa491 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.167327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 164/318] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:20.172355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec438-cccb-4f4f-bb16-9789d7bf099c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.172770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec438-cccb-4f4f-bb16-9789d7bf099c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.172907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec438-cccb-4f4f-bb16-9789d7bf099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.191531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9ebec438-cccb-4f4f-bb16-9789d7bf099c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:20.192756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9ebec438-cccb-4f4f-bb16-9789d7bf099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:20.201025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 155/319] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:20.224607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8740-e51f-4d19-877e-a21230caa491 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.241119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8740-e51f-4d19-877e-a21230caa491 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.246038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.246836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.247111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.247377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.259750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:20.266527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:20.272391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 165/320] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:20.273651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec438-cccb-4f4f-bb16-9789d7bf099c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.283201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec438-cccb-4f4f-bb16-9789d7bf099c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.287610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.288369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.288721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.289066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.289902 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:20.290279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.292648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.301847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 156/321] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:20.308117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.320529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337639-b386-4c34-9982-b6be8038462f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.324943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28204430-725e-4a8f-a03c-37ada715a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.325913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204430-725e-4a8f-a03c-37ada715a322 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.326292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204430-725e-4a8f-a03c-37ada715a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.326661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204430-725e-4a8f-a03c-37ada715a322 admin admin] PATH_INFO: `/v3/users/bb24aaaed2784aaeba25d976ad353a8f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.327983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28204430-725e-4a8f-a03c-37ada715a322 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb24aaaed2784aaeba25d976ad353a8f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.330219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28204430-725e-4a8f-a03c-37ada715a322 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.332173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 166/322] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/users/bb24aaaed2784aaeba25d976ad353a8f => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:20.337999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.350572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53293-8cc7-4f38-b21d-0d4c683b6703 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.353323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca98e-fc56-43c2-a563-5ab7a902b220 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.353609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca98e-fc56-43c2-a563-5ab7a902b220 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.353876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca98e-fc56-43c2-a563-5ab7a902b220 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.356276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 167/323] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:20.356383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.356968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.357315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.357652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.358560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] RBAC: Adding query filter params (role.id=195819215583470b80fa053d7de42a6c, user.id=bb24aaaed2784aaeba25d976ad353a8f, scope.system=all) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:20.358974 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.360868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.361088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025770-966a-4a5e-b4ac-c4318fbd5a38 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.361374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025770-966a-4a5e-b4ac-c4318fbd5a38 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.361651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025770-966a-4a5e-b4ac-c4318fbd5a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.379912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-45025770-966a-4a5e-b4ac-c4318fbd5a38 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:20.380439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 157/324] 10.222.0.88 () {56 vars in 1329 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/role_assignments?user.id=bb24aaaed2784aaeba25d976ad353a8f&scope.system=all&role.id=195819215583470b80fa053d7de42a6c => generated 510 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:20.381187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-45025770-966a-4a5e-b4ac-c4318fbd5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:20.389142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 168/325] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:20.412741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.423853 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c166e5-475d-454c-9fd1-fdf382819902 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.428147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.428958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.429238 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.429511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.430791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.433144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.435059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 158/326] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:20.436944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f42b9-9761-4990-81b8-d79284909312 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.437237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f42b9-9761-4990-81b8-d79284909312 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.437512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f42b9-9761-4990-81b8-d79284909312 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.439415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 169/327] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:20.440940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.445246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d033a-a40b-480b-8c54-3d23d2a6b75d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.445524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d033a-a40b-480b-8c54-3d23d2a6b75d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.445794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d033a-a40b-480b-8c54-3d23d2a6b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.451513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7bce-4c93-47d6-b587-6d2a8ea0e265 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.456878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.457554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.457863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.458103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] PATH_INFO: `/v3/groups` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.458873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.460814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.464657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2e1d033a-a40b-480b-8c54-3d23d2a6b75d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:20.466055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2e1d033a-a40b-480b-8c54-3d23d2a6b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:20.474349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 170/328] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:20.498573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d033a-a40b-480b-8c54-3d23d2a6b75d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.508022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d033a-a40b-480b-8c54-3d23d2a6b75d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.513055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.513962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.514255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.514515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.526494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:20.533799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:20.535076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 171/329] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:20.540913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.551584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9c792-fb96-4251-8f2b-207cb0e1d4c9 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.556279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.556934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.557212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.557485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.558247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:20.558550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.560197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.569408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 172/330] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:20.574954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.580955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 159/331] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jan 17 09:34:20 2022] POST /identity/v3/groups => generated 226 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:34:20.586188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55353441-c509-4ce5-825a-6b7ee79ee8db admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.592077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb47c5-0dd5-44cb-83b6-fd21cd383fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.593529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb47c5-0dd5-44cb-83b6-fd21cd383fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.593529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb47c5-0dd5-44cb-83b6-fd21cd383fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.593529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb47c5-0dd5-44cb-83b6-fd21cd383fa4 admin admin] PATH_INFO: `/v3/users/cf99b32783a846999ea0a01e2576ea58` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.594813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb47c5-0dd5-44cb-83b6-fd21cd383fa4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf99b32783a846999ea0a01e2576ea58)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.597088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb47c5-0dd5-44cb-83b6-fd21cd383fa4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.598861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 173/332] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:20 2022] GET /identity/v3/users/cf99b32783a846999ea0a01e2576ea58 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:20.605377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:20.619327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b573a-faae-4d17-b732-f03805eaca75 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:20.624237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cac78b-966c-455e-b6da-7b5902f8fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:20.625121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac78b-966c-455e-b6da-7b5902f8fac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:20.625404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac78b-966c-455e-b6da-7b5902f8fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:20.625676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac78b-966c-455e-b6da-7b5902f8fac6 admin admin] PATH_INFO: `/v3/system/users/cf99b32783a846999ea0a01e2576ea58/roles/7d0c26a4e4a64cb78fe8534e9cd46760` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:20.627320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cac78b-966c-455e-b6da-7b5902f8fac6 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cf99b32783a846999ea0a01e2576ea58, role_id=7d0c26a4e4a64cb78fe8534e9cd46760)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:20.628782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-07cac78b-966c-455e-b6da-7b5902f8fac6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:20.628782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:20.628782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:20.629682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cac78b-966c-455e-b6da-7b5902f8fac6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:20.721405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 160/333] 10.222.0.88 () {58 vars in 1355 bytes} [Mon Jan 17 09:34:20 2022] PUT /identity/v3/system/users/cf99b32783a846999ea0a01e2576ea58/roles/7d0c26a4e4a64cb78fe8534e9cd46760 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:23.156692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e75be-dd3e-4bd1-b160-d9b58b141b7c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.157219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e75be-dd3e-4bd1-b160-d9b58b141b7c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.157509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e75be-dd3e-4bd1-b160-d9b58b141b7c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.160080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 174/334] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:23.165440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c359e-09fd-4dd7-991d-4d71275fdb9c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.165899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c359e-09fd-4dd7-991d-4d71275fdb9c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.165986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c359e-09fd-4dd7-991d-4d71275fdb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.187761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-401c359e-09fd-4dd7-991d-4d71275fdb9c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:23.188963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-401c359e-09fd-4dd7-991d-4d71275fdb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:23.197237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 161/335] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:23.221729 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e75be-dd3e-4bd1-b160-d9b58b141b7c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.236415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e75be-dd3e-4bd1-b160-d9b58b141b7c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.240714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.241492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.241767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.242033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.261825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:23.268648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:23.269850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 175/336] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:23.276399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c359e-09fd-4dd7-991d-4d71275fdb9c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.288000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c359e-09fd-4dd7-991d-4d71275fdb9c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.299086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.299768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.300054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.300329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.301104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:23.301411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.303040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.314657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 162/337] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:23.320030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.342984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec49e-e543-4e5e-a55e-9ac673eb6fe6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.347512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.348464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.348736 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.349003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.362774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.367069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.381197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 176/338] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:23.386964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.403944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a82d9-d274-4137-9d94-71dac165b964 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.415538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5d01-7943-4f49-9022-867cd94893e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.416879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5d01-7943-4f49-9022-867cd94893e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.417207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5d01-7943-4f49-9022-867cd94893e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.417512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5d01-7943-4f49-9022-867cd94893e3 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.423644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5d01-7943-4f49-9022-867cd94893e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.425728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5d01-7943-4f49-9022-867cd94893e3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.427915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 163/339] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:23.434520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.437369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137de4-29cb-4282-836c-aabade6005fd None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.437652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137de4-29cb-4282-836c-aabade6005fd None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.437933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137de4-29cb-4282-836c-aabade6005fd None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.439967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 164/340] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:23.444979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadfd19-dcfb-4ff4-8c66-5bc5f203f078 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.445262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadfd19-dcfb-4ff4-8c66-5bc5f203f078 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.445540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadfd19-dcfb-4ff4-8c66-5bc5f203f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.446115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e05613-0a7b-4122-ae18-8cf6a46f2a9a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.451128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.455503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.455503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.455503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.463521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.464564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:23.464564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:23.464564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:23.465765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.467973 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 177/341] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:23.473746 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6aadfd19-dcfb-4ff4-8c66-5bc5f203f078 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:23.474953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6aadfd19-dcfb-4ff4-8c66-5bc5f203f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:23.484573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.497378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 165/342] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:23.500546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdb72d-a469-48c6-8e64-58aff91eb9e0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.505077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.505724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.506008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.506278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.507139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=195819215583470b80fa053d7de42a6c, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:23.507446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.509275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.517485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 178/343] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=195819215583470b80fa053d7de42a6c => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:23.539953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadfd19-dcfb-4ff4-8c66-5bc5f203f078 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.557869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadfd19-dcfb-4ff4-8c66-5bc5f203f078 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.567292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.568112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.568389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.568663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.591981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:23.599041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:23.600453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 166/344] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:23.607014 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.622862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11495bd-9ab3-4fed-86a6-36c42f4ba2b5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.627387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.628049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.628321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.628586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.629335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:23.629633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.637602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.651596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 179/345] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:23.653615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.668586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae82a4-eb8b-41b2-b6bf-4b011389c62d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.673220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.673900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.674225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.674449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.690993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.692849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.704949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 167/346] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:23.710418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.720952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87026c-a2be-4e4f-8a3d-b865332df001 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.725301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.726160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.726435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.726705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.727921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.730040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.732100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 180/347] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:23.737797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.747396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3c081-c3fb-44cd-847d-c47af263c5cc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.752218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489b914-783c-4ec8-a160-a01c5e442f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.753085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489b914-783c-4ec8-a160-a01c5e442f13 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.753358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489b914-783c-4ec8-a160-a01c5e442f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.753629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489b914-783c-4ec8-a160-a01c5e442f13 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.754934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489b914-783c-4ec8-a160-a01c5e442f13 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.756040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-7489b914-783c-4ec8-a160-a01c5e442f13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:23.756040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:23.756040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:23.757222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489b914-783c-4ec8-a160-a01c5e442f13 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.759216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 168/348] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:23.767676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:23.777649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee0b18-32e9-4d57-8460-c4a5531e8123 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:23.782146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc9d1-e159-4228-9e75-3eb82e3a4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:23.785196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc9d1-e159-4228-9e75-3eb82e3a4776 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.785511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc9d1-e159-4228-9e75-3eb82e3a4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.785792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc9d1-e159-4228-9e75-3eb82e3a4776 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:23.786654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc9d1-e159-4228-9e75-3eb82e3a4776 admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=195819215583470b80fa053d7de42a6c, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:23.786987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc9d1-e159-4228-9e75-3eb82e3a4776 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:23.788859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc9d1-e159-4228-9e75-3eb82e3a4776 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:23.795589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 181/349] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:23 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=195819215583470b80fa053d7de42a6c => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:23.998838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aab6a-deff-4e0c-9fc5-978b3c55d17d None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:23.999178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aab6a-deff-4e0c-9fc5-978b3c55d17d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:23.999351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aab6a-deff-4e0c-9fc5-978b3c55d17d None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.001339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 169/350] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:24.007263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4417-74ae-4cf0-8b05-1d0c4653e5ba None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.007526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4417-74ae-4cf0-8b05-1d0c4653e5ba None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.007795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a4417-74ae-4cf0-8b05-1d0c4653e5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.027242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d74a4417-74ae-4cf0-8b05-1d0c4653e5ba None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:24.028431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d74a4417-74ae-4cf0-8b05-1d0c4653e5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:24.036634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 182/351] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:24.081193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aab6a-deff-4e0c-9fc5-978b3c55d17d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.096793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aab6a-deff-4e0c-9fc5-978b3c55d17d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.101114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.101474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990ce8f-c6bb-410d-8906-d7b35001f667 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.101815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990ce8f-c6bb-410d-8906-d7b35001f667 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.102006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.102194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990ce8f-c6bb-410d-8906-d7b35001f667 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.102349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.102497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.104585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 183/352] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:24.110247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828fd0-4ed2-4cac-9097-374387d95714 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.110518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828fd0-4ed2-4cac-9097-374387d95714 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.110898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828fd0-4ed2-4cac-9097-374387d95714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.128202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:24.135699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 17 09:34:24.146842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 170/353] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:24.147210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-23828fd0-4ed2-4cac-9097-374387d95714 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:24.149287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-23828fd0-4ed2-4cac-9097-374387d95714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:24.149416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.161635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 184/354] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:24.165968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4dbfe-3775-4ca3-8e0c-033a6b189a08 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.174455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.175423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.175868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.176335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.177361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:24.177814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.179681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.190254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 171/355] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:24.195595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828fd0-4ed2-4cac-9097-374387d95714 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.202224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.209617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828fd0-4ed2-4cac-9097-374387d95714 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.220634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.221877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.222298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.222759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] PATH_INFO: `/v3/users/cf99b32783a846999ea0a01e2576ea58` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.225287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf99b32783a846999ea0a01e2576ea58)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.227346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04440d98-326f-417b-9783-4c02243b588a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.230858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.233284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 185/356] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/users/cf99b32783a846999ea0a01e2576ea58 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:24.241328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.245674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.248061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.248490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.248995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.266347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949877d-566c-4cad-805c-8009ae46d114 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.274321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:24.278574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.279476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.279934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.281846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.283215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] RBAC: Adding query filter params (role.id=7d0c26a4e4a64cb78fe8534e9cd46760, user.id=cf99b32783a846999ea0a01e2576ea58, scope.system=all) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:24.285015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.289262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.294566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:24.298615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 172/357] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:24.303781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.322933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46712e9-791d-47ab-b8ba-7cb011692877 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.323440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 186/358] 10.222.0.88 () {56 vars in 1329 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/role_assignments?user.id=cf99b32783a846999ea0a01e2576ea58&scope.system=all&role.id=7d0c26a4e4a64cb78fe8534e9cd46760 => generated 510 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:24.333611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.334658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.335150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.335574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.336590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:24.337072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.339642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.356433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 173/359] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:24.362168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.375421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066de92-174b-4941-9533-a578d4152161 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.381054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.381794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.382138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.382466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.395964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.399588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.415604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 187/360] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:24.422263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.432601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92430e-f6c8-42ad-91af-4eda4d622dda admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.439322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.440266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.440549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.440823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.442124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.444408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.446296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 174/361] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:24.452667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.461978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df2dc0-88c0-43b0-9855-33dc581b5033 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.467578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea66d58-2379-465e-a2d4-131467cf9427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.468512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66d58-2379-465e-a2d4-131467cf9427 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.468798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66d58-2379-465e-a2d4-131467cf9427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.469126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66d58-2379-465e-a2d4-131467cf9427 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.475550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea66d58-2379-465e-a2d4-131467cf9427 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.477701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea66d58-2379-465e-a2d4-131467cf9427 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.480205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 188/362] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:24.486004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:24.496471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4ea62-60db-40d4-8652-ff733bb018c4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:24.507335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e8682-208b-4baf-a37f-c895d9f19edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:24.508036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8682-208b-4baf-a37f-c895d9f19edf admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.508323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8682-208b-4baf-a37f-c895d9f19edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.508605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8682-208b-4baf-a37f-c895d9f19edf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.509522 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8682-208b-4baf-a37f-c895d9f19edf admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:24.509835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8682-208b-4baf-a37f-c895d9f19edf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:24.511963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8682-208b-4baf-a37f-c895d9f19edf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:24.518569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 175/363] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:24 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:24.982033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1e2f9-15c9-4d17-a9e8-d95c0ec7566f None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.982424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1e2f9-15c9-4d17-a9e8-d95c0ec7566f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.982607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1e2f9-15c9-4d17-a9e8-d95c0ec7566f None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:24.984628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 189/364] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:24.990290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc40f-29b8-4eaf-a26b-7bf30268abbc None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:24.990591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc40f-29b8-4eaf-a26b-7bf30268abbc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:24.990898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc40f-29b8-4eaf-a26b-7bf30268abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.015032 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2ffdc40f-29b8-4eaf-a26b-7bf30268abbc None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:25.016227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2ffdc40f-29b8-4eaf-a26b-7bf30268abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:25.030809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 176/365] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:25.080252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1e2f9-15c9-4d17-a9e8-d95c0ec7566f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.096658 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1e2f9-15c9-4d17-a9e8-d95c0ec7566f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.103993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.104812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.105091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.105360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.120464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:25.127720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:25.130212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 190/366] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:25.134969 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdc40f-29b8-4eaf-a26b-7bf30268abbc None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.144704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdc40f-29b8-4eaf-a26b-7bf30268abbc None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.154980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.155653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.155929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.156199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.156973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:25.157279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.159178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.174318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 177/367] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:25.179692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.195999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e7bb-3062-4baf-a237-7adfcaf779d7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.204848 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.205504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.205787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.206054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.218577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.220392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.237014 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 191/368] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:25.242384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.255664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca938cc2-69d1-4c2c-bdfe-9013c9636b77 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.260899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.261750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.262027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.262299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.267609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.269719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.271725 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 178/369] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:25.277384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.286784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e4c86-6a9c-45f7-9971-d731d62fed83 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.294904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14982aad-cfbb-42cb-a01e-568536b1a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.295772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982aad-cfbb-42cb-a01e-568536b1a867 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.296053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982aad-cfbb-42cb-a01e-568536b1a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.296324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14982aad-cfbb-42cb-a01e-568536b1a867 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.303555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14982aad-cfbb-42cb-a01e-568536b1a867 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.305505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14982aad-cfbb-42cb-a01e-568536b1a867 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.308137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 192/370] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:25.313918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.328295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d465b3-40b7-48e3-b9e8-3508d05c68f7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.335460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfd9e-8208-457c-99b0-05d12b2544c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.336147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfd9e-8208-457c-99b0-05d12b2544c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.336429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfd9e-8208-457c-99b0-05d12b2544c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.336701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfd9e-8208-457c-99b0-05d12b2544c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.337562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccfd9e-8208-457c-99b0-05d12b2544c0 admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:25.337870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccfd9e-8208-457c-99b0-05d12b2544c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.339865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccfd9e-8208-457c-99b0-05d12b2544c0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.346356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 179/371] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:25.664855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae108a5-ee77-48af-b3df-91eeddd28262 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.665121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae108a5-ee77-48af-b3df-91eeddd28262 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.665438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae108a5-ee77-48af-b3df-91eeddd28262 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.667886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 193/372] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:25.673312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a739f2-9f9d-46e4-bc74-9f6351379267 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.673623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a739f2-9f9d-46e4-bc74-9f6351379267 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.673870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a739f2-9f9d-46e4-bc74-9f6351379267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.696197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-25a739f2-9f9d-46e4-bc74-9f6351379267 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:25.697768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-25a739f2-9f9d-46e4-bc74-9f6351379267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:25.706657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 180/373] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:25.732113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae108a5-ee77-48af-b3df-91eeddd28262 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.749975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae108a5-ee77-48af-b3df-91eeddd28262 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.756828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.757619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.757898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.758175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.773135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:25.780685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:25.783163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 194/374] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:25.788225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a739f2-9f9d-46e4-bc74-9f6351379267 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.800877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a739f2-9f9d-46e4-bc74-9f6351379267 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.805843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.806800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.807846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.808315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.809279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:25.809798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.811712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.829276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 181/375] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:25.835041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.847762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe13de-8489-4d2c-b260-c06e78eabad2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.854866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.855532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.855818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.856094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.864549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.866358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.883390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 195/376] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:25.889783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.905460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe441d3-ee17-464d-b935-e20cdb66d8cd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.910545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.911720 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.912249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.918816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.920890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.922903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.924945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 182/377] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:25.930345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.945421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e2b0-ed8d-4d48-84bf-1125c1205682 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.953485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874eb564-a329-4feb-afe8-480a9dead77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.954529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eb564-a329-4feb-afe8-480a9dead77c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.955039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eb564-a329-4feb-afe8-480a9dead77c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.955347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eb564-a329-4feb-afe8-480a9dead77c admin admin] PATH_INFO: `/v3/groups/0da283044d0b4c2e99f91df79d81a30e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.964157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eb564-a329-4feb-afe8-480a9dead77c admin admin] RBAC: Authorizing `identity:get_group(group_id=0da283044d0b4c2e99f91df79d81a30e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:25.966204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eb564-a329-4feb-afe8-480a9dead77c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:25.968138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 196/378] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/groups/0da283044d0b4c2e99f91df79d81a30e => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:25.974092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:25.984973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22985ea-a0b6-4131-bb42-eae1e04ed3d4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:25.996040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e3966-c847-4cda-a212-b17995a9ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:25.996770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e3966-c847-4cda-a212-b17995a9ffa0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:25.997053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e3966-c847-4cda-a212-b17995a9ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:25.997431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e3966-c847-4cda-a212-b17995a9ffa0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:25.998514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e3966-c847-4cda-a212-b17995a9ffa0 admin admin] RBAC: Adding query filter params (group.id=0da283044d0b4c2e99f91df79d81a30e, role.id=c81c29874f234512920b18621694f614, scope.project.id=21fc0e2d15dd458c8be52038432f65bf) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:25.998917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e3966-c847-4cda-a212-b17995a9ffa0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:26.000912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e3966-c847-4cda-a212-b17995a9ffa0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:26.007595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 183/379] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:25 2022] GET /identity/v3/role_assignments?group.id=0da283044d0b4c2e99f91df79d81a30e&scope.project.id=21fc0e2d15dd458c8be52038432f65bf&role.id=c81c29874f234512920b18621694f614 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:26.874832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c1f4-df21-4e5d-bf84-851afcac023c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:26.875335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c1f4-df21-4e5d-bf84-851afcac023c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:26.875410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2c1f4-df21-4e5d-bf84-851afcac023c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:26.877344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 197/380] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:26.882951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8417f-33ba-4d99-82fe-c0a3016e2e2e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:26.883372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8417f-33ba-4d99-82fe-c0a3016e2e2e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:26.883605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8417f-33ba-4d99-82fe-c0a3016e2e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:26.908134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a7f8417f-33ba-4d99-82fe-c0a3016e2e2e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:26.909342 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a7f8417f-33ba-4d99-82fe-c0a3016e2e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:26.917825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 184/381] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:26.924436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4b1b9-4971-4b74-963f-009aade20e57 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:26.924724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4b1b9-4971-4b74-963f-009aade20e57 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:26.925003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4b1b9-4971-4b74-963f-009aade20e57 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:26.927078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 198/382] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:26.932848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac263f-e125-40ab-9ca8-ae344595b0d1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:26.933129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac263f-e125-40ab-9ca8-ae344595b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:26.933400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac263f-e125-40ab-9ca8-ae344595b0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:26.952341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a7ac263f-e125-40ab-9ca8-ae344595b0d1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:26.953524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a7ac263f-e125-40ab-9ca8-ae344595b0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:26.957183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4b1b9-4971-4b74-963f-009aade20e57 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:26.972026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4b1b9-4971-4b74-963f-009aade20e57 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:26.979746 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 185/383] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:26.983024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:26.983828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:26.984113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:26.984388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.009249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:27.016480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:27.022171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 199/384] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:27.023396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac263f-e125-40ab-9ca8-ae344595b0d1 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.031447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.039742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac263f-e125-40ab-9ca8-ae344595b0d1 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.047537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.048253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.048532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.048796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.049558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:27.049859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.051523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.055845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461d76a-c57a-463e-bc9f-8bb5032cf66b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.066226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 186/385] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:27.066965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.067748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.068023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.068289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.073991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.090329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:27.097283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:27.102985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb83205-edb0-4278-8af2-089f1548ad8b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.105515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 200/386] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:27.108710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.109617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.109898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.110169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.111721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.113687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.115957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 187/387] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:27.116993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.123688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.142531 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed42f91-46f7-4d2a-9a0c-8d460ae8cfc0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.149241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ab3f-5a9e-490e-8795-b2d4628c625a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.155749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.157460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.158005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.158795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.159701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.159975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.160241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.160472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.161242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] RBAC: Adding query filter params (name=member) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:27.161543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.163848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.164710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.168254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.170691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 188/388] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:27.178323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.184744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 201/389] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:27.192964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.195473 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047d8f-ff0e-4cc9-ac47-30e7720e4f97 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.208459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d58def-8816-46c2-8099-2cb6d929f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.209399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d58def-8816-46c2-8099-2cb6d929f493 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.209679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d58def-8816-46c2-8099-2cb6d929f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.209949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d58def-8816-46c2-8099-2cb6d929f493 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/groups/c63558895529476d86143e50716af787/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.211100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff785a-c255-47bb-aacc-49a85d3d4bee admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.214504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d58def-8816-46c2-8099-2cb6d929f493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba5562a3f2468fafae342c0ce4fde7, group_id=c63558895529476d86143e50716af787, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.219141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d58def-8816-46c2-8099-2cb6d929f493 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.224236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.225148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.225425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.225689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.227466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.229495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.231467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 202/390] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:27.237078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.248484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd555-19de-4df0-885c-6bd568cf6ee6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.253636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.254549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.254867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.255193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.256546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.258777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.264734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 203/391] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:27.267560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:27.278467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e6a20-76fc-4cb3-b3c0-5c280973be94 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:27.283807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e54e5-9272-4519-b5eb-46e424b8995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:27.284769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e54e5-9272-4519-b5eb-46e424b8995a admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.285111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e54e5-9272-4519-b5eb-46e424b8995a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.285356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e54e5-9272-4519-b5eb-46e424b8995a admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/groups/c63558895529476d86143e50716af787/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.287593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e54e5-9272-4519-b5eb-46e424b8995a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd, group_id=c63558895529476d86143e50716af787, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:27.290748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e54e5-9272-4519-b5eb-46e424b8995a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:27.304263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 189/392] 10.222.0.88 () {58 vars in 1463 bytes} [Mon Jan 17 09:34:27 2022] PUT /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/groups/c63558895529476d86143e50716af787/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:34:27.370463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 204/393] 10.222.0.88 () {58 vars in 1463 bytes} [Mon Jan 17 09:34:27 2022] PUT /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/groups/c63558895529476d86143e50716af787/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:34:27.616054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf84d6-efd7-47a0-88f1-60f4f0731179 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.616484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf84d6-efd7-47a0-88f1-60f4f0731179 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.616664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf84d6-efd7-47a0-88f1-60f4f0731179 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.618600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 190/394] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:27.625668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2077fa-6f31-4943-a8bd-e4860cf193d8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:27.625668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2077fa-6f31-4943-a8bd-e4860cf193d8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:27.625668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2077fa-6f31-4943-a8bd-e4860cf193d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:27.645465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2d2077fa-6f31-4943-a8bd-e4860cf193d8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:27.646918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2d2077fa-6f31-4943-a8bd-e4860cf193d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:27.949166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 205/395] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:27.984487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf84d6-efd7-47a0-88f1-60f4f0731179 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.004493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf84d6-efd7-47a0-88f1-60f4f0731179 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.013665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.014469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.014756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.015045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.031648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:28.039064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:28.040562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 191/396] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:28.046370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2077fa-6f31-4943-a8bd-e4860cf193d8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.060271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2077fa-6f31-4943-a8bd-e4860cf193d8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.067013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.067916 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.068357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.068793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.069703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:28.070154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.076026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.089723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 206/397] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:28.094866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.107242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c59b8-ec25-4042-bc01-d9a9c7513844 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.118410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.119849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.120136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.120409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.127774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.129727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.131769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 192/398] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:28.138075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.153592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b878-c25b-4914-9bed-7b30e8c2bd62 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.161584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde7277-0a7b-4f83-bb55-d3cb838c814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.162676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7277-0a7b-4f83-bb55-d3cb838c814a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.163163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7277-0a7b-4f83-bb55-d3cb838c814a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.163615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7277-0a7b-4f83-bb55-d3cb838c814a admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.166943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde7277-0a7b-4f83-bb55-d3cb838c814a admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.169202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde7277-0a7b-4f83-bb55-d3cb838c814a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.171456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 207/399] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:28.177926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.194338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44ec43-76a1-4b6a-8ec8-610e47438d09 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.203066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcce10a-f2c0-4b17-9f6a-869d12fe3cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.203897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcce10a-f2c0-4b17-9f6a-869d12fe3cde admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.204176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcce10a-f2c0-4b17-9f6a-869d12fe3cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.204451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcce10a-f2c0-4b17-9f6a-869d12fe3cde admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/groups/c63558895529476d86143e50716af787/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.212626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcce10a-f2c0-4b17-9f6a-869d12fe3cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd, group_id=c63558895529476d86143e50716af787, role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.215866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcce10a-f2c0-4b17-9f6a-869d12fe3cde admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.319833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 193/400] 10.222.0.88 () {58 vars in 1463 bytes} [Mon Jan 17 09:34:28 2022] PUT /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd/groups/c63558895529476d86143e50716af787/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:28.526756 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1737d55-fa90-45b0-8506-7a97a7812841 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.526756 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1737d55-fa90-45b0-8506-7a97a7812841 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.526756 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1737d55-fa90-45b0-8506-7a97a7812841 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.526756 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 208/401] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:28.535877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad4fb1-60ad-4f63-9074-2907fc5a7d16 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.536245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad4fb1-60ad-4f63-9074-2907fc5a7d16 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.536438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad4fb1-60ad-4f63-9074-2907fc5a7d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.574536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-edad4fb1-60ad-4f63-9074-2907fc5a7d16 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:28.576156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-edad4fb1-60ad-4f63-9074-2907fc5a7d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:28.653090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 194/402] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:28.684585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1737d55-fa90-45b0-8506-7a97a7812841 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.705053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1737d55-fa90-45b0-8506-7a97a7812841 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.713787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.714607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.714999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.715272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.729920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:28.737235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:28.738473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 209/403] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:28.745431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad4fb1-60ad-4f63-9074-2907fc5a7d16 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.759741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad4fb1-60ad-4f63-9074-2907fc5a7d16 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.771062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.772308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.772792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.773272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.774245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:28.774789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.777241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.792582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 195/404] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:28.797847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.812348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813f0d1-f0bf-4bf3-9d41-f0d168bb10a9 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.822873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.823731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.824024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.824297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.830320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.832301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.834262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 210/405] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:28.840399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.855566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175147e-96e0-482f-b27d-f2b9a1472729 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.860406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2025d3d-cf69-467a-aa30-502c5106b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.861528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025d3d-cf69-467a-aa30-502c5106b0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.862018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025d3d-cf69-467a-aa30-502c5106b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.862489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025d3d-cf69-467a-aa30-502c5106b0d1 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.863932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2025d3d-cf69-467a-aa30-502c5106b0d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.866191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2025d3d-cf69-467a-aa30-502c5106b0d1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.868395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 196/406] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:28.873776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.886815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4a32-5366-468d-b28d-c75c37977da4 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.887440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4a32-5366-468d-b28d-c75c37977da4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.887871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d14ad-b51d-4da8-b9bf-97939ad114c0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.888141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4a32-5366-468d-b28d-c75c37977da4 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.890451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 197/407] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:28.894661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.895556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.895842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.895954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3ae4-adbe-4315-8492-43e5ee77d4a8 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.896141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/groups/c63558895529476d86143e50716af787/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.896667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3ae4-adbe-4315-8492-43e5ee77d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.897175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3ae4-adbe-4315-8492-43e5ee77d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.904804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba5562a3f2468fafae342c0ce4fde7, group_id=c63558895529476d86143e50716af787, role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:28.907342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:28.919358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-73ed3ae4-adbe-4315-8492-43e5ee77d4a8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:28.920900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-73ed3ae4-adbe-4315-8492-43e5ee77d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:28.930135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 198/408] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:28.955898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3ae4-adbe-4315-8492-43e5ee77d4a8 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:28.967130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3ae4-adbe-4315-8492-43e5ee77d4a8 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:28.972354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:28.973480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:28.973986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:28.974493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:28.986886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:28.993408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 211/409] 10.222.0.88 () {58 vars in 1463 bytes} [Mon Jan 17 09:34:28 2022] PUT /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7/groups/c63558895529476d86143e50716af787/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:28.995846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:28.997704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 199/410] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:29.004589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:29.075894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f2f8a-8b8f-4c80-9156-f349753abf4b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:29.080782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:29.081808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:29.082344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:29.082915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:29.083913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:29.084426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:29.086282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:29.096928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 212/411] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:29.102802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:29.114598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffa103-bdfb-47ea-9bd6-78a14f029402 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:29.119830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:29.120999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:29.121583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:29.122121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] PATH_INFO: `/v3/groups/0da283044d0b4c2e99f91df79d81a30e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:29.123632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] RBAC: Authorizing `identity:get_group(group_id=0da283044d0b4c2e99f91df79d81a30e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:29.125803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:29.128026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 200/412] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:29 2022] GET /identity/v3/groups/0da283044d0b4c2e99f91df79d81a30e => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:29.133931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:29.145003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76fe27-c6b1-4847-a902-6e3a98c8992e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:29.150147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346db76-861f-4226-a891-b9e71bd626fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:29.152110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346db76-861f-4226-a891-b9e71bd626fd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:29.152750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346db76-861f-4226-a891-b9e71bd626fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:29.153243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346db76-861f-4226-a891-b9e71bd626fd admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:29.155058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346db76-861f-4226-a891-b9e71bd626fd admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:29.157237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346db76-861f-4226-a891-b9e71bd626fd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:29.159910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 213/413] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:29 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:29.165807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:29.178036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6b888-7991-4a09-a6d0-d94bbf126d28 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:29.183170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcbceb-7dfc-4b69-90d3-027f93949e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:29.184375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbceb-7dfc-4b69-90d3-027f93949e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:29.184894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbceb-7dfc-4b69-90d3-027f93949e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:29.185360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbceb-7dfc-4b69-90d3-027f93949e38 admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf/groups/0da283044d0b4c2e99f91df79d81a30e/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:29.187712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcbceb-7dfc-4b69-90d3-027f93949e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fc0e2d15dd458c8be52038432f65bf, group_id=0da283044d0b4c2e99f91df79d81a30e, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:29.191020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcbceb-7dfc-4b69-90d3-027f93949e38 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:29.267008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 201/414] 10.222.0.88 () {58 vars in 1463 bytes} [Mon Jan 17 09:34:29 2022] PUT /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf/groups/0da283044d0b4c2e99f91df79d81a30e/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:29.979984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49995-3a1d-494d-9427-24a2d32cc604 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:29.980685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49995-3a1d-494d-9427-24a2d32cc604 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:29.981254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49995-3a1d-494d-9427-24a2d32cc604 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:29.983828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 214/415] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:29.989615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e90f-4a07-4b8b-aef1-6b81dd2fac9f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:29.990515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e90f-4a07-4b8b-aef1-6b81dd2fac9f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:29.991024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e90f-4a07-4b8b-aef1-6b81dd2fac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.011154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-0601e90f-4a07-4b8b-aef1-6b81dd2fac9f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:30.012667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0601e90f-4a07-4b8b-aef1-6b81dd2fac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:30.072190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 202/416] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:30.098457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49995-3a1d-494d-9427-24a2d32cc604 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.112123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49995-3a1d-494d-9427-24a2d32cc604 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.116764 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.117880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.118362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.118887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.129724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:30.139435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:30.141274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 215/417] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:30.147308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e90f-4a07-4b8b-aef1-6b81dd2fac9f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.157398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e90f-4a07-4b8b-aef1-6b81dd2fac9f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.162361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1e70-8d58-4c5c-998a-a8803e584501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.163330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1e70-8d58-4c5c-998a-a8803e584501 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.163816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1e70-8d58-4c5c-998a-a8803e584501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.164291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1e70-8d58-4c5c-998a-a8803e584501 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.165275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf1e70-8d58-4c5c-998a-a8803e584501 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:30.165794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf1e70-8d58-4c5c-998a-a8803e584501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.167709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf1e70-8d58-4c5c-998a-a8803e584501 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.178417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 203/418] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:30.184329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.191059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e43e-e7ca-40a0-adef-65e2ab7c80ff None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.191337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e43e-e7ca-40a0-adef-65e2ab7c80ff None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.191619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e43e-e7ca-40a0-adef-65e2ab7c80ff None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.193535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 204/419] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:30.196697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffa743-6940-4713-b40f-274abff32203 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.199073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3ebe-34b1-4b21-8401-1c60be7144db None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.199358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3ebe-34b1-4b21-8401-1c60be7144db None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.199634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3ebe-34b1-4b21-8401-1c60be7144db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.202796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.203865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.204342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.204901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.215076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.217125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.228215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 216/420] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:30.231868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-fe1e3ebe-34b1-4b21-8401-1c60be7144db None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:30.233051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fe1e3ebe-34b1-4b21-8401-1c60be7144db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:30.235253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.247071 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ccd6d-1553-4083-8d5b-3597023b6fb7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.248474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 205/421] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:30.252483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.253690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.254199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.254683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.256278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.261498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.264122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 217/422] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:30.269917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e3ebe-34b1-4b21-8401-1c60be7144db None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.281975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e3ebe-34b1-4b21-8401-1c60be7144db None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.287206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.288299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.288778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.289275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.290651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.292890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.300478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.305935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0db84-9cca-42e0-ab35-64ae1acdd3d9 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.311917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 206/423] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:30.315255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.316267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.316744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.317209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.320794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.339614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957500e-b06d-40fe-af3c-05d7d5695fb2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.344407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.345328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.345837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.346309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.347386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=195819215583470b80fa053d7de42a6c, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:30.347930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.350052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.356525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:30.359904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 207/424] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=195819215583470b80fa053d7de42a6c => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:30.362659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 17 09:34:30.369895 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 218/425] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:30.375871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.392633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3246952-4fc0-4cd9-bd85-9e3d6cab10db admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.398052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.399067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.399577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.400070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.401636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:30.402285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.404173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.419361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 208/426] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:30.424525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.436717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35a7c3-8eab-45e0-ae32-6ddc91c37e53 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.448769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.449502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.449782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.450090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.466465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.468476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.482018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 219/427] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:30.487094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.499313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5330fa5-1f85-4813-914b-4c84e75212d0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.504391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.505505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.505939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.506364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.512317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.514667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.516681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 209/428] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:30.522492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.533006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1492-ecab-4ad0-b9ae-1f8b4d571ecc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.544562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcaa1b-6048-44f1-a7d1-28343ae81fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.545508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcaa1b-6048-44f1-a7d1-28343ae81fcd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.545789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcaa1b-6048-44f1-a7d1-28343ae81fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.546118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcaa1b-6048-44f1-a7d1-28343ae81fcd admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.551660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcaa1b-6048-44f1-a7d1-28343ae81fcd admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.553659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcaa1b-6048-44f1-a7d1-28343ae81fcd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.555859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 220/429] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:30.561421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:30.574280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad596d-43ec-48ac-b481-a831cc1f1bff admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:30.579286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec90d8e-341f-4640-bdc9-da917c6de359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:30.580208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90d8e-341f-4640-bdc9-da917c6de359 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:30.580700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90d8e-341f-4640-bdc9-da917c6de359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:30.581173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90d8e-341f-4640-bdc9-da917c6de359 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:30.582368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90d8e-341f-4640-bdc9-da917c6de359 admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=195819215583470b80fa053d7de42a6c, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:30.582931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90d8e-341f-4640-bdc9-da917c6de359 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:30.585051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90d8e-341f-4640-bdc9-da917c6de359 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:30.595468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 210/430] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:30 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=195819215583470b80fa053d7de42a6c => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:31.468794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb82e-8126-496b-8f99-cd3662952294 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.469298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb82e-8126-496b-8f99-cd3662952294 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.469604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb82e-8126-496b-8f99-cd3662952294 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.471761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 221/431] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:31.477222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524db9-ba96-4d15-aa45-d9ccccc4c115 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.477694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524db9-ba96-4d15-aa45-d9ccccc4c115 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.477771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524db9-ba96-4d15-aa45-d9ccccc4c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.496584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-03524db9-ba96-4d15-aa45-d9ccccc4c115 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:31.497790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-03524db9-ba96-4d15-aa45-d9ccccc4c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:31.505614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 211/432] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:31.530866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcb82e-8126-496b-8f99-cd3662952294 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.543841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcb82e-8126-496b-8f99-cd3662952294 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.548666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.549580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.549859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.552807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.562159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:31.569470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:31.570915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 222/433] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:31.577584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03524db9-ba96-4d15-aa45-d9ccccc4c115 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.586756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03524db9-ba96-4d15-aa45-d9ccccc4c115 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.591739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.592400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.592680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.592955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.593763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:31.594176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.595941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.604798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 212/434] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:31.610469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.620288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d6af5-76ee-4f15-9048-89f8cd2a0c07 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.624821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.625455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.625732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.626003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.635653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.637471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.646867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 223/435] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:34:31.652944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.662713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2430-6caa-41b5-9e56-d34c88fc292f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.667195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.668031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.668306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.668573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.669763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.671951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.673805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 213/436] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:31.679029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.688096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4f56-2e1c-4846-b13a-9117a5aa68f5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.692423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17987-cd73-4f88-a398-de47076d08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.693257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17987-cd73-4f88-a398-de47076d08f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.693533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17987-cd73-4f88-a398-de47076d08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.693804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17987-cd73-4f88-a398-de47076d08f2 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.695003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17987-cd73-4f88-a398-de47076d08f2 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.697105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17987-cd73-4f88-a398-de47076d08f2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.699469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 224/437] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:31.704938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.715311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd78fe-729a-4bbf-bdfb-e04ead5d4716 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.720063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c342a-09ea-49ed-988e-d2d82baf97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.720776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c342a-09ea-49ed-988e-d2d82baf97a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.721149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c342a-09ea-49ed-988e-d2d82baf97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.721496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c342a-09ea-49ed-988e-d2d82baf97a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.722407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c342a-09ea-49ed-988e-d2d82baf97a7 admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:31.722814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c342a-09ea-49ed-988e-d2d82baf97a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.724671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c342a-09ea-49ed-988e-d2d82baf97a7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.734755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 214/438] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=d174e4e879fc4a7f9d1c64d85c6c67bd&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:31.775483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5bd0e-418f-4a52-89f0-3a6905cc1972 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.776349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5bd0e-418f-4a52-89f0-3a6905cc1972 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.776623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5bd0e-418f-4a52-89f0-3a6905cc1972 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.778645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 225/439] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:31.785203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499f92a-5a53-4b5a-9a71-1137b4757596 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.785642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499f92a-5a53-4b5a-9a71-1137b4757596 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.786043 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499f92a-5a53-4b5a-9a71-1137b4757596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.810819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e499f92a-5a53-4b5a-9a71-1137b4757596 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:31.812056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e499f92a-5a53-4b5a-9a71-1137b4757596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:31.820098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 215/440] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:31.845362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5bd0e-418f-4a52-89f0-3a6905cc1972 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.858350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5bd0e-418f-4a52-89f0-3a6905cc1972 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.863452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.864283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.864566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.864837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.878092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:31.886145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:31.887620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 226/441] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:31.893644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499f92a-5a53-4b5a-9a71-1137b4757596 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.902914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499f92a-5a53-4b5a-9a71-1137b4757596 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.909410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.910088 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.910372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.910645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.911462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:31.911768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.913388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.925057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 216/442] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:31.931033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.941310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56496ebf-51c0-4e9b-9f72-27f5c25cb86e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.946169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.946829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.947112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.947976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.957067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.958866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.968740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 227/443] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:31.975086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:31.985975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef94cb-63a4-450d-972b-9c29fc58f728 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:31.991355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:31.992879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:31.992879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:31.992879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] PATH_INFO: `/v3/projects/39ba5562a3f2468fafae342c0ce4fde7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:31.995344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=39ba5562a3f2468fafae342c0ce4fde7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:31.997409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:31.999354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 217/444] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:31 2022] GET /identity/v3/projects/39ba5562a3f2468fafae342c0ce4fde7 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:32.004950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.014894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae15ac9-01ba-4f82-aa90-36210ddcfaa3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.019259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6f784-d17f-44f7-99b7-e0d6ef149bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.020110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f784-d17f-44f7-99b7-e0d6ef149bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.020398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f784-d17f-44f7-99b7-e0d6ef149bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.020655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f784-d17f-44f7-99b7-e0d6ef149bb8 admin admin] PATH_INFO: `/v3/groups/c63558895529476d86143e50716af787` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.021830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6f784-d17f-44f7-99b7-e0d6ef149bb8 admin admin] RBAC: Authorizing `identity:get_group(group_id=c63558895529476d86143e50716af787)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:32.023757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6f784-d17f-44f7-99b7-e0d6ef149bb8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:32.025391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 228/445] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/groups/c63558895529476d86143e50716af787 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:32.031259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.041785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827285b-e886-40dd-a065-8934adb487b0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.047144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7876-3e70-4403-97a1-4850d66c3326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.048019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7876-3e70-4403-97a1-4850d66c3326 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.048324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7876-3e70-4403-97a1-4850d66c3326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.048597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7876-3e70-4403-97a1-4850d66c3326 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.049438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7876-3e70-4403-97a1-4850d66c3326 admin admin] RBAC: Adding query filter params (group.id=c63558895529476d86143e50716af787, role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=39ba5562a3f2468fafae342c0ce4fde7) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:32.049749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7876-3e70-4403-97a1-4850d66c3326 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:32.051639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7876-3e70-4403-97a1-4850d66c3326 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:32.058637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 218/446] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/role_assignments?group.id=c63558895529476d86143e50716af787&scope.project.id=39ba5562a3f2468fafae342c0ce4fde7&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:32.105640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24844-00b8-4b40-bf0a-f19f915718a4 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.105928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24844-00b8-4b40-bf0a-f19f915718a4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.106207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24844-00b8-4b40-bf0a-f19f915718a4 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.108219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 229/447] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:32.114040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c7710-bd82-423e-8c2d-abd86679e915 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.114388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c7710-bd82-423e-8c2d-abd86679e915 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.114671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c7710-bd82-423e-8c2d-abd86679e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.134490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c62c7710-bd82-423e-8c2d-abd86679e915 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:32.136954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c62c7710-bd82-423e-8c2d-abd86679e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:32.144940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 219/448] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:32.170670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24844-00b8-4b40-bf0a-f19f915718a4 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.184586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24844-00b8-4b40-bf0a-f19f915718a4 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.190918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.191753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.192021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.192292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.204264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:32.211310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:32.215538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 230/449] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:32.218903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c7710-bd82-423e-8c2d-abd86679e915 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.229359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c7710-bd82-423e-8c2d-abd86679e915 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.234187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.235025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.235426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.235803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.236716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:32.237196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:32.238985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:32.249156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 220/450] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:32.255115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.265402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0967a6-22e9-45e1-8e7f-991fdc9285af admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.270126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.271023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.271293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.271574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.281405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:32.283479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:32.293613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 231/451] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:32.299451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.310243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e927e-ce20-4485-a3e6-8a68edf75e63 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.314975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.315841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.316121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.316399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.318967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:32.321003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:32.322774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 221/452] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:32.328639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.337924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c7ce-35ff-4c50-bb25-bbbfeae72d09 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.342489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d95a93-a14f-4ae8-91d0-1a66d60122a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.343375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d95a93-a14f-4ae8-91d0-1a66d60122a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.343654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d95a93-a14f-4ae8-91d0-1a66d60122a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.343929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d95a93-a14f-4ae8-91d0-1a66d60122a4 admin admin] PATH_INFO: `/v3/groups/0da283044d0b4c2e99f91df79d81a30e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.345133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d95a93-a14f-4ae8-91d0-1a66d60122a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=0da283044d0b4c2e99f91df79d81a30e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:32.347088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d95a93-a14f-4ae8-91d0-1a66d60122a4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:32.348699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 232/453] 10.222.0.88 () {56 vars in 1201 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/groups/0da283044d0b4c2e99f91df79d81a30e => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:32.355324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:32.365787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286e613-02ee-4fb5-9bf8-cecedb389ccc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:32.371876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6697-70ec-41c5-9eaa-b8ae4b9ccdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:32.372539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6697-70ec-41c5-9eaa-b8ae4b9ccdda admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:32.372822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6697-70ec-41c5-9eaa-b8ae4b9ccdda admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:32.373104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6697-70ec-41c5-9eaa-b8ae4b9ccdda admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:32.373959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6697-70ec-41c5-9eaa-b8ae4b9ccdda admin admin] RBAC: Adding query filter params (group.id=0da283044d0b4c2e99f91df79d81a30e, role.id=c81c29874f234512920b18621694f614, scope.project.id=21fc0e2d15dd458c8be52038432f65bf) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:32.374270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6697-70ec-41c5-9eaa-b8ae4b9ccdda admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:32.376283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6697-70ec-41c5-9eaa-b8ae4b9ccdda admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:32.382614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 222/454] 10.222.0.88 () {56 vars in 1397 bytes} [Mon Jan 17 09:34:32 2022] GET /identity/v3/role_assignments?group.id=0da283044d0b4c2e99f91df79d81a30e&scope.project.id=21fc0e2d15dd458c8be52038432f65bf&role.id=c81c29874f234512920b18621694f614 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:35.367395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a65dd-8a91-47a2-8b0a-436a2a24d894 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.367912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a65dd-8a91-47a2-8b0a-436a2a24d894 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.367912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a65dd-8a91-47a2-8b0a-436a2a24d894 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.370934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 233/455] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:35.376863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168493b-6c50-4e42-9b78-fa105dc5a480 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.377371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168493b-6c50-4e42-9b78-fa105dc5a480 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.377445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168493b-6c50-4e42-9b78-fa105dc5a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.405374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1168493b-6c50-4e42-9b78-fa105dc5a480 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:35.406576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1168493b-6c50-4e42-9b78-fa105dc5a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:35.417980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 223/456] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:35.428083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca0a2e-805a-433d-bb46-3f7d70c012f7 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.428383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca0a2e-805a-433d-bb46-3f7d70c012f7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.428629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca0a2e-805a-433d-bb46-3f7d70c012f7 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.430387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 234/457] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:35.436754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717f64-0016-4fb0-b705-55aa677e6ac4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.437044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717f64-0016-4fb0-b705-55aa677e6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.437307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717f64-0016-4fb0-b705-55aa677e6ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.443400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca0a2e-805a-433d-bb46-3f7d70c012f7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.462446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca0a2e-805a-433d-bb46-3f7d70c012f7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.467329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.468210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.468495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.468770 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.469893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-19717f64-0016-4fb0-b705-55aa677e6ac4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:35.471326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-19717f64-0016-4fb0-b705-55aa677e6ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:35.480154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 224/458] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:35.486959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.486959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.487178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adefdf-bae5-458d-96c2-1e983fbcaf07 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.487178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adefdf-bae5-458d-96c2-1e983fbcaf07 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.487178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adefdf-bae5-458d-96c2-1e983fbcaf07 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.495186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 225/459] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:35.500442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf6b1-0d9f-4851-850d-89c29cca7b9e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.500718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf6b1-0d9f-4851-850d-89c29cca7b9e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.500989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf6b1-0d9f-4851-850d-89c29cca7b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.508851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:35.510118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 235/460] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:35.515509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.525781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-44caf6b1-0d9f-4851-850d-89c29cca7b9e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:35.526697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0814ad-2b5f-439f-b927-25dd2ef91d4b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.526997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-44caf6b1-0d9f-4851-850d-89c29cca7b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:35.531355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.532140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.532683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.533056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.535382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 226/461] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:35.536183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caf6b1-0d9f-4851-850d-89c29cca7b9e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.549946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.551816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.554321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caf6b1-0d9f-4851-850d-89c29cca7b9e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.567491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.568166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.568442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.568713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.569465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:35.569766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.569981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:35.571575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 236/462] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:35.571705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.579646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.588842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 227/463] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:35.589653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.591519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee3e90-aeac-432c-801d-3faa77830d33 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.596815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.597881 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.598162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.598428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.599585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283e7f-581d-4a5a-bfcd-f9161fbbcabd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.604607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.605254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.605530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.605799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.606527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:35.606857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.608450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.610259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.612546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.620494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 228/464] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:35.625532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.631303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:35.633317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 237/465] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:35.634403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.636047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01294b-bad0-46da-ab0a-731392748024 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.640866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320038-f92d-4d8b-b30b-e6cabea7d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.641521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320038-f92d-4d8b-b30b-e6cabea7d2ec admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.641796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320038-f92d-4d8b-b30b-e6cabea7d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.642065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320038-f92d-4d8b-b30b-e6cabea7d2ec admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.642804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320038-f92d-4d8b-b30b-e6cabea7d2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.644357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae55e-933a-4aea-bc65-5e7810e9c1ef admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.644707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320038-f92d-4d8b-b30b-e6cabea7d2ec admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.648663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.649302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.649582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.649854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.651170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.654073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.759763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 229/466] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/users => generated 246 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:35.761070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b711-c299-443c-85d0-42ddc8c15974 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.761359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b711-c299-443c-85d0-42ddc8c15974 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.761635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b711-c299-443c-85d0-42ddc8c15974 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.763659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 230/467] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:35.765512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0b711-c299-443c-85d0-42ddc8c15974 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.779925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0b711-c299-443c-85d0-42ddc8c15974 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.785275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bfa44-3d73-42e4-99a7-8f87d679dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.786321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bfa44-3d73-42e4-99a7-8f87d679dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.786841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bfa44-3d73-42e4-99a7-8f87d679dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.787309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bfa44-3d73-42e4-99a7-8f87d679dbb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.788335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bfa44-3d73-42e4-99a7-8f87d679dbb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:35.797349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bfa44-3d73-42e4-99a7-8f87d679dbb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.797349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bfa44-3d73-42e4-99a7-8f87d679dbb9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.805314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 231/468] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:35.806905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc851e-2b82-4d50-a88f-7d55ace89474 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.807400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc851e-2b82-4d50-a88f-7d55ace89474 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.807827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc851e-2b82-4d50-a88f-7d55ace89474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.826257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 238/469] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:35.827394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.828170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4efc851e-2b82-4d50-a88f-7d55ace89474 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:35.829528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4efc851e-2b82-4d50-a88f-7d55ace89474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:35.838548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 232/470] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:35.844880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a7e8a-caf9-46b6-bd8a-9e2707935f92 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.849945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136312c5-92cb-44c3-a9f9-66cfca5e2707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.850945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136312c5-92cb-44c3-a9f9-66cfca5e2707 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.851401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136312c5-92cb-44c3-a9f9-66cfca5e2707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.851869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136312c5-92cb-44c3-a9f9-66cfca5e2707 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.852783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136312c5-92cb-44c3-a9f9-66cfca5e2707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.855631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136312c5-92cb-44c3-a9f9-66cfca5e2707 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.868149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc851e-2b82-4d50-a88f-7d55ace89474 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.882829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc851e-2b82-4d50-a88f-7d55ace89474 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.885170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.886060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.886491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.887856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.901672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.904902 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.926122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:35.927857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 233/471] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:35.933942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.945069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d390bc-c9e2-46c2-a932-f45307fb6b66 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:35.950559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:35.951271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:35.951553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:35.951829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:35.952598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:35.952906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:35.954619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:35.972000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 234/472] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:35.978300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:35.978908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 239/473] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/users => generated 248 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:35.993847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20524217-8d08-4dc7-8a78-96a8f7dcd362 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:36.005781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25d157-6414-4ff7-8263-1f4588f2e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:36.006484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d157-6414-4ff7-8263-1f4588f2e135 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:36.006808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d157-6414-4ff7-8263-1f4588f2e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:36.007084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d157-6414-4ff7-8263-1f4588f2e135 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:36.007843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25d157-6414-4ff7-8263-1f4588f2e135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:36.010438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25d157-6414-4ff7-8263-1f4588f2e135 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:36.115196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 235/474] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:35 2022] POST /identity/v3/users => generated 249 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:34:36.608863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f118df4-d415-4b99-8e55-8f15abc3f026 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:36.609364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f118df4-d415-4b99-8e55-8f15abc3f026 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:36.609473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f118df4-d415-4b99-8e55-8f15abc3f026 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:36.611771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 240/475] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:36.617864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58da7e7-7cbc-453e-9822-ba02ab2d424f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:36.618278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58da7e7-7cbc-453e-9822-ba02ab2d424f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:36.618448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58da7e7-7cbc-453e-9822-ba02ab2d424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:36.640304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a58da7e7-7cbc-453e-9822-ba02ab2d424f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:36.641712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a58da7e7-7cbc-453e-9822-ba02ab2d424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:36.650632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 236/476] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:36.674305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f118df4-d415-4b99-8e55-8f15abc3f026 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:36.691280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f118df4-d415-4b99-8e55-8f15abc3f026 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:36.699311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:36.700148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:36.700572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:36.700987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:36.702098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:36.703879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:36.760458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.sql.core [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 17 09:34:36.760458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 17 09:34:36.760458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [parameters: {'id': '90c1068c0cb046d999d3ed208cf44d84', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 17 09:34:36.760458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 17 09:34:36.775568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 17 09:34:36.777214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 241/477] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:34:36 2022] POST /identity/v3/roles => generated 144 bytes in 103 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:36.783914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58da7e7-7cbc-453e-9822-ba02ab2d424f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:36.796373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58da7e7-7cbc-453e-9822-ba02ab2d424f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:36.807729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67bea3-26d0-4de7-a150-a066625ae8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:36.808770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67bea3-26d0-4de7-a150-a066625ae8ef admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:36.809199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67bea3-26d0-4de7-a150-a066625ae8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:36.809602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67bea3-26d0-4de7-a150-a066625ae8ef admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:36.823833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67bea3-26d0-4de7-a150-a066625ae8ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:36.834069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-8b67bea3-26d0-4de7-a150-a066625ae8ef admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 17 09:34:36.835514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 237/478] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:34:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:36.841313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:36.859957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65e719-6f8b-4153-989c-3c9d7c7f3004 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:36.867091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2efbd-bf24-4030-879f-be05bb533f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:36.867765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2efbd-bf24-4030-879f-be05bb533f89 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:36.868051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2efbd-bf24-4030-879f-be05bb533f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:36.868320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2efbd-bf24-4030-879f-be05bb533f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:36.869673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2efbd-bf24-4030-879f-be05bb533f89 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:36.869966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2efbd-bf24-4030-879f-be05bb533f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:36.871707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2efbd-bf24-4030-879f-be05bb533f89 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:36.886898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 242/479] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:38.516817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626495-f622-481d-bbaa-f3e37f603917 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.517329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626495-f622-481d-bbaa-f3e37f603917 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.517329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626495-f622-481d-bbaa-f3e37f603917 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.519568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 238/480] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:38.525824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb062-3255-4087-a613-2c03fe054571 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.526329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb062-3255-4087-a613-2c03fe054571 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.526400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb062-3255-4087-a613-2c03fe054571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.550799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7bcdb062-3255-4087-a613-2c03fe054571 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:38.552035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7bcdb062-3255-4087-a613-2c03fe054571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:38.560469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 243/481] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 17 09:34:38.584709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626495-f622-481d-bbaa-f3e37f603917 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.597146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626495-f622-481d-bbaa-f3e37f603917 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.601465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.602255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.602534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.602838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.615353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:38.625403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:38.626929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 239/482] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:38.633423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdb062-3255-4087-a613-2c03fe054571 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.643259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdb062-3255-4087-a613-2c03fe054571 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.647718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.648372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.648648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.648917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.649674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:38.649975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:38.651624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:38.661131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 244/483] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:38.666313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.675989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bcd7-97b6-4646-83c9-1e12fe55dcae admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.680403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.681188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.682005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.682278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.693377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:38.695270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:38.712480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:38.714011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 240/484] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:38.719786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.729693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e613fb-6867-4f81-b0ec-c7dc43872240 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.738315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.739001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.739280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.739553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.740282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:38.740584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:38.741605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:38.741605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:38.741605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:38.742476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:38.765832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 245/485] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:38.770926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.783993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fb40-b35b-49ba-abb9-649ee9b39dcd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.791348 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae3381-38a6-4ed2-8889-aa88579f1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.792152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3381-38a6-4ed2-8889-aa88579f1299 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.792429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3381-38a6-4ed2-8889-aa88579f1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.792697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3381-38a6-4ed2-8889-aa88579f1299 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.801083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae3381-38a6-4ed2-8889-aa88579f1299 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:38.803160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae3381-38a6-4ed2-8889-aa88579f1299 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:38.817208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-77ae3381-38a6-4ed2-8889-aa88579f1299 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:34:38.818580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 241/486] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:38.824829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.835052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b3ed-c30e-42ac-84a8-26587b7bcb12 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.835377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a08f-638c-4216-9722-5d790734aff8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.835574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b3ed-c30e-42ac-84a8-26587b7bcb12 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.835574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b3ed-c30e-42ac-84a8-26587b7bcb12 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.837906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 242/487] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:38.839696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.840355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.840633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.840902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.841810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:38.842117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:38.842957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db637-1bf5-461a-8916-a757d0208174 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.843207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:38.843207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:38.843207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:38.843607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db637-1bf5-461a-8916-a757d0208174 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.843607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db637-1bf5-461a-8916-a757d0208174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.844362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:38.884108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-541db637-1bf5-461a-8916-a757d0208174 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:38.885371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-541db637-1bf5-461a-8916-a757d0208174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:38.902281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 243/488] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:38.902611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 246/489] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:38.903550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e28fa-faba-4da9-87d7-ba8954397a2e None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.903831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e28fa-faba-4da9-87d7-ba8954397a2e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.904101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e28fa-faba-4da9-87d7-ba8954397a2e None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.910389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 244/490] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:38.911123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.922223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e536ee-4f20-457f-a66c-ab9f1c52fd7c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.922500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e536ee-4f20-457f-a66c-ab9f1c52fd7c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.923082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e536ee-4f20-457f-a66c-ab9f1c52fd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.924984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64970-8d13-48c3-b56d-0f266a5252ba admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.930912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.932156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.932441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.932717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.944406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:38.946244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:38.947525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-86e536ee-4f20-457f-a66c-ab9f1c52fd7c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:38.948698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-86e536ee-4f20-457f-a66c-ab9f1c52fd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:38.957073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 247/491] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:38.957907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.958903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 245/492] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:38.963672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e536ee-4f20-457f-a66c-ab9f1c52fd7c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:38.977073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bdc93-332d-4b31-94eb-832ac9f1f1d6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.980882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e536ee-4f20-457f-a66c-ab9f1c52fd7c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:38.987616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.989500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:38.990270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.990492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:38.990803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.991121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:38.991585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:38.991850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.004885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.007023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.007572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:39.016111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:39.017644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 248/493] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.018430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.033766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:39.035169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 246/494] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.035364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674767-3ab7-450a-9f04-7122cb5c08e5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.035779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.044049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.044842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.045309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.045630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.051212 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfaaf9-f204-4dff-a7ae-769764fb51a8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.055994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.057313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.057489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:39.057654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.057906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.058680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.059103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.060827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.064329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:39.065817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 249/495] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.066597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.077034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 247/496] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.077919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.080659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd4cea-b237-4532-9d52-18f21826e530 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.085065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.085722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.086001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.086272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.087039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.087338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.088786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b4aa3-dc6e-4ccf-873a-87d9e3acd54b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.089063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.094091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73def745-83b0-4bc9-bde1-0d4398258be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.094837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73def745-83b0-4bc9-bde1-0d4398258be9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.095126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73def745-83b0-4bc9-bde1-0d4398258be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.095393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73def745-83b0-4bc9-bde1-0d4398258be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.096271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73def745-83b0-4bc9-bde1-0d4398258be9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.096577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73def745-83b0-4bc9-bde1-0d4398258be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.098281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73def745-83b0-4bc9-bde1-0d4398258be9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.102603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 250/497] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.105150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.108844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 248/498] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.110149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318df6-79ac-4eb9-a081-dd4b35a66607 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.110438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318df6-79ac-4eb9-a081-dd4b35a66607 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.110716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318df6-79ac-4eb9-a081-dd4b35a66607 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.112359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 249/499] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:39.116705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e318df6-79ac-4eb9-a081-dd4b35a66607 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.118299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa4a2-6a00-4dbd-be24-e21789361da2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.123194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.123983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.124259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.124543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.126160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e318df6-79ac-4eb9-a081-dd4b35a66607 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.130582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c6274-45d6-4747-9f4f-f0d3bda8dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.131384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c6274-45d6-4747-9f4f-f0d3bda8dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.131668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c6274-45d6-4747-9f4f-f0d3bda8dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.131942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c6274-45d6-4747-9f4f-f0d3bda8dc87 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.135091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.136870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.139065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c6274-45d6-4747-9f4f-f0d3bda8dc87 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.141010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c6274-45d6-4747-9f4f-f0d3bda8dc87 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.154250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:39.154948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-0b6c6274-45d6-4747-9f4f-f0d3bda8dc87 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:39.160382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 251/500] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.160604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 250/501] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.160604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06703ef-82da-491f-bf13-c680a20adce9 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.160604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06703ef-82da-491f-bf13-c680a20adce9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.160604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06703ef-82da-491f-bf13-c680a20adce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.160850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.171534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc935-5625-4471-ada2-078824d82e81 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.176271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.177051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.177329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.177598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.178720 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a06703ef-82da-491f-bf13-c680a20adce9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:39.179925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a06703ef-82da-491f-bf13-c680a20adce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:39.188786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.190887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.199007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 251/502] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:39.199832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06703ef-82da-491f-bf13-c680a20adce9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.214672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:39.216036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 252/503] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.216142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06703ef-82da-491f-bf13-c680a20adce9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.216671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.221372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.222110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.222388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.222661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.224051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.224527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.225562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:39.225562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:39.225562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:39.226389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c87e0-39f2-40dd-bdc4-ac0ce9ac8956 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.226678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.231235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.231870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.232165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.232406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.233124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.233422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.235035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.251452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 252/504] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.251631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 253/505] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.251631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.251938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.262213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e601-2c26-4683-aa2f-b0b25cb49a46 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.262389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b7a4-ee12-4260-a354-34a825b97615 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.266593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.267213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.267361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.267643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.267910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.268133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.268516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.268900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.269898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.270139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.271881 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.278855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:39.289882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 254/506] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.289882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.290122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:39.290122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 253/507] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.290122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.300041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3139b9-ed58-4917-a2ae-90d3cbb42e2f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.304036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1712-8cde-4337-bb2e-d2d93b1efe32 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.304477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.305238 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.305568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.305790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.309207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.309946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.310234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.310509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.311388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=3d4b284f0c1348bb9baa47b4c531821e) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.311700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.313572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.314870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.317062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.327017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 255/508] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/role_assignments?user.id=3d4b284f0c1348bb9baa47b4c531821e&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.327017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.330131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855b41b-6b1b-4f55-b8e1-79fcceef2967 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.341113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.342091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.342447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.342864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.343012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 17 09:34:39.344520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 254/509] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.345421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.356566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.358846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.360352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2529738-38aa-49e7-8e26-2f32796b6c4c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.368701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.369894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.369894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.370061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.374593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.374593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.374593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.375887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 17 09:34:39.377295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 256/510] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.378011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.388431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7ecb5-701c-4117-bcfe-3b1c6352000f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.393381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.394071 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.394551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.395032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.395619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 255/511] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.396415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.396732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.397053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.398952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.409224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c064883-fee9-4105-b847-57def3bbc42c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.415481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.417021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.417426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.417837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.418956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.419374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.420628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:39.420628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:39.420628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:39.422045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.426056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 257/512] 10.222.0.88 () {56 vars in 1158 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.427119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.437732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd6fa-704e-4fa4-84d9-75f87db3afeb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.442379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.443284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.443492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.443764 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.455357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.457383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.465629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 256/513] 10.222.0.88 () {56 vars in 1158 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.467004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.476275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:39.477464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f5789-96c5-4a3a-830d-c19f54287092 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.477577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 258/514] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.479060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.488399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.489129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.489411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.489686 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.495273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a78265-98e4-438d-9df4-87d21412364a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.499424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.500526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.501409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.501895 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.502399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.502925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.511741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.513856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.520104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 257/515] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:39.520104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.531748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a25e3-d337-42ee-b1df-ee97fca03b77 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.531845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 259/516] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:39.531845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.533733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.534478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.534938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.535290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.536160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.536546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.539254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.544537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e912e-bb80-48b7-9009-8ff9eb2dbe7e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.549613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.550431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.550712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.551018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.555795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 258/517] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.556888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.567484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.569050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dc447-7085-495e-b5b5-a303737517e3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.569362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.575440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.576388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.576679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.576954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.590791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.591213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:39.592783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 260/518] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.592889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.593381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.606464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964ad4-4faa-4f99-9ee9-63faf1da633d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.611524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.612352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.612530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:39.612694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.613026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.614128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 259/519] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.615076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.622892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.624983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.630127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31c9da-b9b1-4528-9067-1db374190784 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.635901 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.636560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.636840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.637122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.638171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.638536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.640151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.647080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 17 09:34:39.655379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 261/520] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.655379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.662819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 260/521] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.664039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.664298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514262-3bf1-4d69-85d3-45beee05cd75 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.669147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.669824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.670106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.670383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.671154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.671458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.673086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.678240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a091ab-f838-4481-ab42-dee9be283086 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.683362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.684366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.684862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.685231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 262/522] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.685862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.686144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.687248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.687753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.689935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.696049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e9f6a-a9d5-452c-a2b4-8cd5bc265ceb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.702028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.702475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.702782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.703060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.711012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.716976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 261/523] 10.222.0.88 () {56 vars in 1160 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.717126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.717242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.730147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd5c0-9c6b-4320-8400-fd0a33011f4b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.735269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.736325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.736752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.737129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.737424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:39.739023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 263/524] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.740380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.745763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.749084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.753263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542134c-5f77-4502-a0cc-4e86fe9975c5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.758914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.760520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.760944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.761430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.764046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:39.765701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 262/525] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.766618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.771941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.773963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.781843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded63c14-81f5-4874-aa62-f1fa2e58c705 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.786603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 264/526] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:39.791744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.791744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.791744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.791744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.792119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.792119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.792503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.792902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.804447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7825e5b-59ec-4110-9b3f-5318dc357041 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.806664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 263/527] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.807666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.810057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.810931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.811436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.811919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.813536 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.814683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.816206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:39.816206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:39.816206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:39.817637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.818523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ff292-5786-42ff-896a-dbd4c6cf5933 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.824739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1f3c2-994e-4904-9236-285ecae9d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.825706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f3c2-994e-4904-9236-285ecae9d06f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.826084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f3c2-994e-4904-9236-285ecae9d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.826533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f3c2-994e-4904-9236-285ecae9d06f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.836807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1f3c2-994e-4904-9236-285ecae9d06f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.837322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 265/528] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.838722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.839658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1f3c2-994e-4904-9236-285ecae9d06f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.848037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe02e9a-359c-41cb-a31d-7240926322c4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.852766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.853432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.853711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.853985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.854843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=fc6c69b3efe444c5893683fa61dc9dfc) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.855151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.857209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b0b1f3c2-994e-4904-9236-285ecae9d06f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:39.857316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.862976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 264/529] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.862976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ae4b-eed2-430a-8c76-52eabfaa978a None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.862976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ae4b-eed2-430a-8c76-52eabfaa978a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.862976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ae4b-eed2-430a-8c76-52eabfaa978a None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.862976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 265/530] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:39.862976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ae4b-eed2-430a-8c76-52eabfaa978a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.870419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 266/531] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/role_assignments?user.id=fc6c69b3efe444c5893683fa61dc9dfc&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.874781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.879985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ae4b-eed2-430a-8c76-52eabfaa978a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.880743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b27b6-6991-4d75-9634-4a6638b65ea4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.886019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c0b61-eb73-453a-bf0d-6bef89a41b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.886273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.886976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.887109 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c0b61-eb73-453a-bf0d-6bef89a41b4f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.887255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.887529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.887627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c0b61-eb73-453a-bf0d-6bef89a41b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.888071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c0b61-eb73-453a-bf0d-6bef89a41b4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.888268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.888622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.889287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c0b61-eb73-453a-bf0d-6bef89a41b4f admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=996e61ee837c4414a6bc725c617cf340) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:39.889741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c0b61-eb73-453a-bf0d-6bef89a41b4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.890218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.892084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c0b61-eb73-453a-bf0d-6bef89a41b4f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.898639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 266/532] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/role_assignments?user.id=996e61ee837c4414a6bc725c617cf340&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.900006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51ec8-0d80-4f7b-a938-b2077696606f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.901099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51ec8-0d80-4f7b-a938-b2077696606f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.901479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51ec8-0d80-4f7b-a938-b2077696606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.904260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 267/533] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:39.910783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.921718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-11e51ec8-0d80-4f7b-a938-b2077696606f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:39.922357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36e551-0c95-4d95-b15b-894eb24adc34 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.923143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-11e51ec8-0d80-4f7b-a938-b2077696606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:39.927620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.928562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.928957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.929378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.932066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 267/534] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:39.945039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:39.947957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:39.958901 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51ec8-0d80-4f7b-a938-b2077696606f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.967987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:39.969608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 268/535] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:39.970864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51ec8-0d80-4f7b-a938-b2077696606f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:39.975148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:39.978555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:39.980009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:39.980593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:39.981129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:39.992088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3891a-a76d-43de-b5d9-adb7affb34f4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:40.004375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:40.007120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:40.007861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:40.008144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:40.008418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:40.010854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:40.011727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:40.013358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:40.015602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:40.047982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 269/536] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:40.050242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:40.051833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 268/537] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:40.054080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:40.060586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:40.072833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb01db0-5d23-4823-8ebd-4941a40236e4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:40.080982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3d56-708f-4b5f-b877-ab6576a3e2a5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:40.082379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:40.083568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:40.083854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:40.084991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:40.087222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=4bc44cadca4c4ac3a3264de0a4641437) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:40.088139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:40.091211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796a20-b656-4d1e-bb39-6522d76aa398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:40.092649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a20-b656-4d1e-bb39-6522d76aa398 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:40.092928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a20-b656-4d1e-bb39-6522d76aa398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:40.093199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a20-b656-4d1e-bb39-6522d76aa398 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:40.093874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:40.096416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f796a20-b656-4d1e-bb39-6522d76aa398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:40.096731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f796a20-b656-4d1e-bb39-6522d76aa398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:40.099759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f796a20-b656-4d1e-bb39-6522d76aa398 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:40.105698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 270/538] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:40 2022] GET /identity/v3/role_assignments?user.id=4bc44cadca4c4ac3a3264de0a4641437&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:40.116415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 269/539] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:40.122794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:40.133120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e48579-195a-429f-8696-38d8740c1f49 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:40.138878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02682c2b-63d7-4879-b234-f47ade43cb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:40.139495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02682c2b-63d7-4879-b234-f47ade43cb9b admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:40.139830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02682c2b-63d7-4879-b234-f47ade43cb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:40.140104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02682c2b-63d7-4879-b234-f47ade43cb9b admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:40.140961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02682c2b-63d7-4879-b234-f47ade43cb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:40.143206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02682c2b-63d7-4879-b234-f47ade43cb9b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:40.217314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 271/540] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:40 2022] POST /identity/v3/users => generated 247 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:34:42.164203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11009436-391f-46a4-8a66-343dc24f4d60 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.164915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11009436-391f-46a4-8a66-343dc24f4d60 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.164915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11009436-391f-46a4-8a66-343dc24f4d60 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.166941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 270/541] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:42.173058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fa39-e45f-4bbf-b660-9790a9b1b3dc None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.173750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fa39-e45f-4bbf-b660-9790a9b1b3dc None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.173750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fa39-e45f-4bbf-b660-9790a9b1b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.203787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c021fa39-e45f-4bbf-b660-9790a9b1b3dc None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:42.205022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c021fa39-e45f-4bbf-b660-9790a9b1b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:42.213867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 272/542] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:42.236274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11009436-391f-46a4-8a66-343dc24f4d60 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.260506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11009436-391f-46a4-8a66-343dc24f4d60 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.268238 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.269090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.269374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.269643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.289741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:42.296588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:42.298150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 271/543] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.303993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fa39-e45f-4bbf-b660-9790a9b1b3dc None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.313897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fa39-e45f-4bbf-b660-9790a9b1b3dc None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.326974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.327654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.327935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.328211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.328981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.329286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.330917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.344845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 273/544] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:42.350345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.366426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f566-2c9a-4aa2-9c0e-0e764f44258b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.379391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86f002-9d81-4535-8914-3e1bbd6d3518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.380197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f002-9d81-4535-8914-3e1bbd6d3518 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.380477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f002-9d81-4535-8914-3e1bbd6d3518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.380747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f002-9d81-4535-8914-3e1bbd6d3518 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.394290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86f002-9d81-4535-8914-3e1bbd6d3518 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.396149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86f002-9d81-4535-8914-3e1bbd6d3518 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.420290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-df86f002-9d81-4535-8914-3e1bbd6d3518 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:42.421469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 272/545] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.427971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.434067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a8e6b-c29b-4c07-b667-2c11f58acc5a None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.434337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a8e6b-c29b-4c07-b667-2c11f58acc5a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.434609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a8e6b-c29b-4c07-b667-2c11f58acc5a None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.438757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 273/546] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:42.442327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394de1-06c6-4f93-a50d-43aee57e4adf None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.442616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394de1-06c6-4f93-a50d-43aee57e4adf None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.442920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394de1-06c6-4f93-a50d-43aee57e4adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.448899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3367b-9c6e-46e6-8a1e-4469e1f7e82e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.463005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.463684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.463960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.464231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.464965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.465295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.466900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.475589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ea394de1-06c6-4f93-a50d-43aee57e4adf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:42.476777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ea394de1-06c6-4f93-a50d-43aee57e4adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:42.493302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 274/547] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:42.494882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 274/548] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:42.500359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394de1-06c6-4f93-a50d-43aee57e4adf None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.516742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394de1-06c6-4f93-a50d-43aee57e4adf None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.526764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.527571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.527851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.528123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.536588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.538641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.558123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.558939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:34:42.564765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 275/549] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.565465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.573060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2190a-011c-4999-9a7a-9a8f7fce6f01 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.575566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa922fd2-7da8-4594-aac0-446bdc9fdd99 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.581038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.581897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.582186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.582462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.583893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.584205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.587127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.590385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.591266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.591544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.591813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.615240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:42.622774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:42.625171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 276/551] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:42.628912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 275/551] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:42.630218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.631499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.644776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296a6f-c9ef-4bc3-a8fb-765dc5755941 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.645791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364f6b-2b7e-459b-9e84-a1c4b228cc78 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.649584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00830c-2c5e-43c5-84e2-f10683e9a0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.650443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00830c-2c5e-43c5-84e2-f10683e9a0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.650749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00830c-2c5e-43c5-84e2-f10683e9a0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.651106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00830c-2c5e-43c5-84e2-f10683e9a0d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.651552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.652214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.652500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.652779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.653546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.653857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.662122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00830c-2c5e-43c5-84e2-f10683e9a0d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.663654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.664115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00830c-2c5e-43c5-84e2-f10683e9a0d1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.681050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 276/552] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:42.688723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-ef00830c-2c5e-43c5-84e2-f10683e9a0d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:42.690020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 277/553] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.691425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.695947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8219-95f6-41ca-bd6e-e578162d7c91 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.695947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8219-95f6-41ca-bd6e-e578162d7c91 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.695947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8219-95f6-41ca-bd6e-e578162d7c91 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.703046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 278/554] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:42.703046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8219-95f6-41ca-bd6e-e578162d7c91 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.707077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708aca-1bce-434d-8861-18557711a34f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.711944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.712295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8219-95f6-41ca-bd6e-e578162d7c91 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.713327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.713822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.714288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.717143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9eba1-98c2-4dda-a305-498bd50c9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.718253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9eba1-98c2-4dda-a305-498bd50c9c8e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.718606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9eba1-98c2-4dda-a305-498bd50c9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.718986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9eba1-98c2-4dda-a305-498bd50c9c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.719801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9eba1-98c2-4dda-a305-498bd50c9c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.720180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9eba1-98c2-4dda-a305-498bd50c9c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.721868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9eba1-98c2-4dda-a305-498bd50c9c8e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.727939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.730601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.736970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 279/555] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:42.739157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f6d09-14bd-4c23-82dc-5d89172d7614 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.740054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f6d09-14bd-4c23-82dc-5d89172d7614 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.740894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f6d09-14bd-4c23-82dc-5d89172d7614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.748864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:42.750105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 277/556] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.754576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.764038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8492a-26f6-4c59-b17c-c5597f8e8dd5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.766790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-455f6d09-14bd-4c23-82dc-5d89172d7614 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:42.768496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-455f6d09-14bd-4c23-82dc-5d89172d7614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:42.768938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2108-778e-418e-ac19-dab0aed67d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.769888 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2108-778e-418e-ac19-dab0aed67d74 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.770246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2108-778e-418e-ac19-dab0aed67d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.770594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2108-778e-418e-ac19-dab0aed67d74 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.778693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2108-778e-418e-ac19-dab0aed67d74 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.779765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 280/557] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:42.781014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f6d09-14bd-4c23-82dc-5d89172d7614 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.781484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2108-778e-418e-ac19-dab0aed67d74 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.792802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f6d09-14bd-4c23-82dc-5d89172d7614 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.798029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.798426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-22bf2108-778e-418e-ac19-dab0aed67d74 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:42.799204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.799662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.800110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.801202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.801711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.804186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.804585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 278/558] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.805936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712619d-e767-46e5-bcb4-10e63449fa70 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.806277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712619d-e767-46e5-bcb4-10e63449fa70 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.807079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712619d-e767-46e5-bcb4-10e63449fa70 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.810792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 279/559] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:42.810792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712619d-e767-46e5-bcb4-10e63449fa70 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.818887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 281/560] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:42.819772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.827905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712619d-e767-46e5-bcb4-10e63449fa70 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.829873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d063ac-7696-4006-b993-3efffdb80881 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.832642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.833444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.833728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.834033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.835148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a2607-9ca5-4bde-9400-1eb6065cad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.835867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a2607-9ca5-4bde-9400-1eb6065cad8d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.836150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a2607-9ca5-4bde-9400-1eb6065cad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.836423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a2607-9ca5-4bde-9400-1eb6065cad8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.837292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a2607-9ca5-4bde-9400-1eb6065cad8d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.837616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a2607-9ca5-4bde-9400-1eb6065cad8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.839883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a2607-9ca5-4bde-9400-1eb6065cad8d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.849530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:42.852783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 282/561] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:42.855068 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9ac2-a2d0-4d8b-b27c-89e0b40bfb8a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.855638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9ac2-a2d0-4d8b-b27c-89e0b40bfb8a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.856085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9ac2-a2d0-4d8b-b27c-89e0b40bfb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.857248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:42.859074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 280/562] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.859869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.871216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583936bb-652d-4b18-9729-12c31a73ea5c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.875933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.876722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.877007 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.877281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.877454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-849e9ac2-a2d0-4d8b-b27c-89e0b40bfb8a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:42.878630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-849e9ac2-a2d0-4d8b-b27c-89e0b40bfb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:42.885785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.887299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 283/563] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:42.887928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.895337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9ac2-a2d0-4d8b-b27c-89e0b40bfb8a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.904789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9ac2-a2d0-4d8b-b27c-89e0b40bfb8a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.907075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 17 09:34:42.909906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.910815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.911090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.911299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 281/564] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.911396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/3d4b284f0c1348bb9baa47b4c531821e/roles/12b074bcc8b34820b03bcf0073c65b0e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.912397 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.923330 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2e73b-e610-411b-b719-38273c43eea3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.927162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=3d4b284f0c1348bb9baa47b4c531821e, role_id=12b074bcc8b34820b03bcf0073c65b0e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.928301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.929151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.929649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.929833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.930265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.931400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.932387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:42.934137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:42.942603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 282/565] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:42.943649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.968367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870600-165d-42bc-adf5-512a589f651d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.968367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.968367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.968367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.968743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.972457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:42.979955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:42.981125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 283/566] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:42.981125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:42.991964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822dcf6-bac5-429d-bd95-07fca19fe283 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:42.997002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:42.997641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:42.997921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:42.998192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:42.999066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:42.999402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.001234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.018654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 284/567] 10.222.0.88 () {56 vars in 1158 bytes} [Mon Jan 17 09:34:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.019275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.029283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa961f0-ff27-4c9a-b8e6-5d8ee206552f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.034850 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 284/568] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:42 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/3d4b284f0c1348bb9baa47b4c531821e/roles/12b074bcc8b34820b03bcf0073c65b0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:43.043785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.094066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.095528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.095528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.095733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.108354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.110687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.130217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:43.131911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 285/569] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.132549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.136798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e73bf-be12-4567-90cb-29c2f86102e3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.142772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.143141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662efe0-5647-4286-8099-54c68faef114 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.144004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.144541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.145109 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.146322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.146918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.148328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.149167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.149309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.149564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.149842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.167142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.167142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.167416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 285/570] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.168419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.181508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f427b-3b5c-4064-b84d-4d7f4c400350 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.186136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.186833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.187117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.187388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.188140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.188448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.190146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.195613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:43.198513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 286/571] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.200078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.203515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 286/572] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.204287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.213775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0c6c0-f60c-42b4-a1db-2f1d0ef530a4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.215260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587e93c-1c05-462e-8a49-e08df6b5ff58 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.219789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.220663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.221022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.221324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.221616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.221711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.221978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.222264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.222774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.223098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.224731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.236031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.237896 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.240578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 287/573] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.241552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.251336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62bf53-e42b-4952-bcbe-e09bfe2fdfb5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.257320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.258252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.258626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.259026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.262820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:43.264161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 287/574] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.264952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.268283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.270720 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.274788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6c647-afee-44cb-b456-e6e69382c3aa admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.279985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.280835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.281116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.281391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.286472 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 17 09:34:43.287832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 288/575] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.288659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.290210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.292821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.304158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129889c-7c23-4758-bf1a-826a04ba3095 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.308622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:43.309830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 288/576] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.310530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.310681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.311213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.311478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.311749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.312523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.312775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.314366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.321108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799281c-bf66-46e8-bf7b-3021a4e16872 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.325681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.326338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.326621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.327203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.327353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 289/577] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.328557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.328557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.328771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.329904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.342070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1476ca2-64e8-4904-a20b-2e14de431f5b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.346863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.347628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.348002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.348390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.349284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.349688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.351685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.352732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 289/578] 10.222.0.88 () {56 vars in 1158 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.354348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.364780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a65c1-19b8-4fb0-8838-97d4ad6596af admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.371537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.372564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.372840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.373114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.377464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 290/579] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.378517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.381036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.383355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.389856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d990b-1473-4ed6-b8ae-3e0d41b2e4b5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.398478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.399469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.399926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.400895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.404915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 17 09:34:43.411759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 290/580] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.411759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.416023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.418049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.424661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8fe85-ebf6-47cb-9cc5-d9b2b3386aa3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.430840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a293c-5c2c-4055-a07d-d185aa90a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.432371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a293c-5c2c-4055-a07d-d185aa90a16a admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.432586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a293c-5c2c-4055-a07d-d185aa90a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.432854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a293c-5c2c-4055-a07d-d185aa90a16a admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/fc6c69b3efe444c5893683fa61dc9dfc/roles/12b074bcc8b34820b03bcf0073c65b0e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.440038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:43.441510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 291/581] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.442180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.454524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304ca54-126f-4817-a98e-7727f46bca2a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.459883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a293c-5c2c-4055-a07d-d185aa90a16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=fc6c69b3efe444c5893683fa61dc9dfc, role_id=12b074bcc8b34820b03bcf0073c65b0e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.460116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44e54e-5195-4113-86fe-b8a12249a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.460771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e54e-5195-4113-86fe-b8a12249a9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.461050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e54e-5195-4113-86fe-b8a12249a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.461317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e54e-5195-4113-86fe-b8a12249a9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.462157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44e54e-5195-4113-86fe-b8a12249a9e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.462477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44e54e-5195-4113-86fe-b8a12249a9e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.462655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a293c-5c2c-4055-a07d-d185aa90a16a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.465467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44e54e-5195-4113-86fe-b8a12249a9e2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.483651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 292/582] 10.222.0.88 () {56 vars in 1160 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.484961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095afd2c-ecbf-4f7b-a852-8d9c93cec217 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.485223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095afd2c-ecbf-4f7b-a852-8d9c93cec217 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.485489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095afd2c-ecbf-4f7b-a852-8d9c93cec217 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.487255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 293/583] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:43.489046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095afd2c-ecbf-4f7b-a852-8d9c93cec217 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.501295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095afd2c-ecbf-4f7b-a852-8d9c93cec217 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.505680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.506312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.506619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.506938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.507724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.508027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.510165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.521764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 294/584] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.522553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.532597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d78cc-6112-442c-b684-b912518b5e42 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.536938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.537691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.537965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.538232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.548615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.550440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.554565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 291/585] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:43 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/fc6c69b3efe444c5893683fa61dc9dfc/roles/12b074bcc8b34820b03bcf0073c65b0e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:43.558324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e7d0c-8935-44a7-a7ce-f28d3d866571 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.558324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e7d0c-8935-44a7-a7ce-f28d3d866571 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.558324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e7d0c-8935-44a7-a7ce-f28d3d866571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.576782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d03e7d0c-8935-44a7-a7ce-f28d3d866571 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:43.580984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:43.581129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d03e7d0c-8935-44a7-a7ce-f28d3d866571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:43.581247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 295/586] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.581247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.593771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6f1f-2d0f-4ce1-b0c1-97b8b182158a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.669725 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.671217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.671857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.672356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.672810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 292/587] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:43.679807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e7d0c-8935-44a7-a7ce-f28d3d866571 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.681402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.683879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.691930 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e7d0c-8935-44a7-a7ce-f28d3d866571 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.700880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:43.703512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 296/588] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.709614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.714911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.716794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.717312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.719150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.719939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.720255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.721886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.726547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0556fe5-84d0-4b6f-a2c5-e14ca68e253c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.731614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.732687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.733230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.733741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.734083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 293/589] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.734959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.735446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.736090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.738824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.745483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7b96b-4d6c-4251-990f-a492d0872c28 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.753526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 297/590] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:43.754361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.754552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.755488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.755775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.756205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.767695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0925df-c7e8-46e1-a521-2f85a73054b4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.769429 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:43.772491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.773343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.773806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.774410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.777103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:43.778909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 294/591] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.779641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.783029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.785168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.794913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf747b-4bcb-4cf0-af12-765a98cb87a5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.799491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.799665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:43.800362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.800630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.800901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/996e61ee837c4414a6bc725c617cf340/roles/12b074bcc8b34820b03bcf0073c65b0e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.805710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 298/592] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.807268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.816521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=996e61ee837c4414a6bc725c617cf340, role_id=12b074bcc8b34820b03bcf0073c65b0e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.817604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaf2f4-878d-40da-adb6-705fd5e5c332 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.819193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.823433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.824219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.824500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.824831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.825602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.825939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.827611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.836450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 299/593] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.837352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.847423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbf9a9-68d3-4014-927d-89e394bd8e5c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.851950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.852597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.852868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.853188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.853988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:43.854292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.856215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.870791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 300/594] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:43.871834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.881587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeef21-7071-4277-8519-7316190f9f2f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.886930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.887781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.888126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.888461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:43.899247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:43.901353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:43.909295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 295/595] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:43 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/996e61ee837c4414a6bc725c617cf340/roles/12b074bcc8b34820b03bcf0073c65b0e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:43.912839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.920804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:43.922402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 301/596] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:43.936558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:43.953189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79445b8-8ea2-4a31-8fc8-af45c9bb74e5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.988799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbd200-cff0-4e64-8a09-45d0b6c495f5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:43.994355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:43.995417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:43.995803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:43.996145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/4bc44cadca4c4ac3a3264de0a4641437/roles/12b074bcc8b34820b03bcf0073c65b0e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.013185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=4bc44cadca4c4ac3a3264de0a4641437, role_id=12b074bcc8b34820b03bcf0073c65b0e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.016104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.042427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.043137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.043414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.043684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.044541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:44.044844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.046594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.060829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 302/597] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:44.066866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.087106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae76a9-6bbb-4151-9360-787e1236563d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.092657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 296/598] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:43 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/4bc44cadca4c4ac3a3264de0a4641437/roles/12b074bcc8b34820b03bcf0073c65b0e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:44.170819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.172434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.172918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.173338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.192165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.196256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.221132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 17 09:34:44.225387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 303/599] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:44.231447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.246079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c7a7c-087f-4075-9e23-f085603f37b2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.252747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.254136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.254828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.255553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.257011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:44.257518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.259807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.289190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 297/600] 10.222.0.88 () {56 vars in 1156 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:44.295415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.306116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703c29-5df7-4e9b-8b44-abcfc6a1e0a3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.313176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.313842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.314114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.314384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.323114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.324955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.340727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 304/601] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:44.346235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.361671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167cbb-cde3-4b6c-9b38-8f7250f6a570 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.366964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.367984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.368432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.369434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.381299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.383425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.403965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:44.405726 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 298/602] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:44.411088 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.421029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32371f-dff0-40d6-becd-41e648c2e3c9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.426006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.426917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.427363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.427782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.428667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:44.429115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.431017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.444458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 305/603] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:44.450613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.463320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d40513-1a01-47f1-94ad-04b16a6ccbdd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.471419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.472220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.472499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.472772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.487924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.489909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.508004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:44.509576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 299/604] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:44.514957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.529145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37969-31b5-45a4-b493-7b9126bb3ee9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.541622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1123-b5e7-4184-b6ae-057ae8a6553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.542962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1123-b5e7-4184-b6ae-057ae8a6553c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.543569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1123-b5e7-4184-b6ae-057ae8a6553c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.544158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1123-b5e7-4184-b6ae-057ae8a6553c admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.545588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1123-b5e7-4184-b6ae-057ae8a6553c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:44.546341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1123-b5e7-4184-b6ae-057ae8a6553c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.549634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1123-b5e7-4184-b6ae-057ae8a6553c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.574204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 306/605] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:44.579664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:44.592424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc23e4-e0d4-43cb-9941-e975705b1eee admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:44.598200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495ddc1-68c2-4e75-ae34-cfb69355dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:44.598971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ddc1-68c2-4e75-ae34-cfb69355dcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:44.599374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ddc1-68c2-4e75-ae34-cfb69355dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:44.599715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ddc1-68c2-4e75-ae34-cfb69355dcd5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:44.600627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495ddc1-68c2-4e75-ae34-cfb69355dcd5 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=9c247c8b8bfe484bb39112144317e59c) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:44.601008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495ddc1-68c2-4e75-ae34-cfb69355dcd5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:44.603046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495ddc1-68c2-4e75-ae34-cfb69355dcd5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:44.612870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 300/606] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:44 2022] GET /identity/v3/role_assignments?user.id=9c247c8b8bfe484bb39112144317e59c&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:45.608813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464a4e-438e-454f-a9e9-a702f411ba48 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:45.609367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464a4e-438e-454f-a9e9-a702f411ba48 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:45.609367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464a4e-438e-454f-a9e9-a702f411ba48 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:45.611777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 307/607] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:45.617417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95732-99ae-40d6-af8b-f8f96ac3a5b0 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:45.618190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95732-99ae-40d6-af8b-f8f96ac3a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:45.619160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95732-99ae-40d6-af8b-f8f96ac3a5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:45.643015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-1ae95732-99ae-40d6-af8b-f8f96ac3a5b0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:45.644461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1ae95732-99ae-40d6-af8b-f8f96ac3a5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:45.654471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 301/608] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:45.704264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464a4e-438e-454f-a9e9-a702f411ba48 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:45.721599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464a4e-438e-454f-a9e9-a702f411ba48 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:45.732929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:45.733965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:45.734394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:45.734834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:45.749715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:45.756998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:45.758791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 308/609] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:45.764556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95732-99ae-40d6-af8b-f8f96ac3a5b0 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:45.778202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95732-99ae-40d6-af8b-f8f96ac3a5b0 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:45.785405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:45.786081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:45.786359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:45.786623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:45.787419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:45.787717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:45.789308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:45.807607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 302/610] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:45.812854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:45.831979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603930a4-ac7c-4ee3-9e80-806feaa8a28f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:45.843103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:45.844252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:45.844734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:45.845208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:45.866669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:45.869438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:45.887501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:45.888915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 309/611] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:45.894488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:45.906660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf877-9f69-4e59-bfff-8f1a31bd2a0c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:45.920288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:45.921078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:45.921544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:45.921820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:45.922568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:45.922899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:45.924521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:45.942009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 303/612] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:45.947309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:45.964094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f31932-c3bb-4da6-a791-94de4e10065f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:45.974468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:45.975282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:45.975560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:45.975829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:45.991980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:45.994769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.012465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:34:46.013993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 310/613] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:34:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:46.019405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.033714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9b4fb-c655-492c-834e-4116f468cf75 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.043356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.044035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.044373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.044648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.045652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.045965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.047902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.078468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 304/614] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:46.084320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.099941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf311044-7801-480b-8c76-6a9ca95cbec9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.108784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.109636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.109636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.109966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.122878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.125194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.137335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 311/615] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:46.143002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.155947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12010f-7f6c-40a2-9e44-d7aa76206720 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.167275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.168128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.168409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.168736 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.187775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.189693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.213034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:46.214279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 305/616] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:46.220113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.229908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186c76c-3f9a-4ff0-b146-132d8baf6a09 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.247489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f6973-3197-45e8-9b9a-125c6c21e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.248175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f6973-3197-45e8-9b9a-125c6c21e99b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.248459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f6973-3197-45e8-9b9a-125c6c21e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.248737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f6973-3197-45e8-9b9a-125c6c21e99b admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.249494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f6973-3197-45e8-9b9a-125c6c21e99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.249799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f6973-3197-45e8-9b9a-125c6c21e99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.251439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f6973-3197-45e8-9b9a-125c6c21e99b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.268520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 312/617] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:46.273850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.287779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22255175-bc0a-4970-816c-6ab52c9e3368 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.294776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.295634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.295917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.296273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.310033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.312074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.325492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f957e9-d78a-4bc1-b664-b2a17b434eb0 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.325806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f957e9-d78a-4bc1-b664-b2a17b434eb0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.326037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f957e9-d78a-4bc1-b664-b2a17b434eb0 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.328133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 313/618] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:46.330009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:46.331572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 306/619] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:46.339766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f19a4-f050-4edb-ba39-4f44f9f79b91 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.340046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f19a4-f050-4edb-ba39-4f44f9f79b91 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.340322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f19a4-f050-4edb-ba39-4f44f9f79b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.346953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.367185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb057b-97ca-46f8-878f-e3bc66188ecf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.374849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-aa7f19a4-f050-4edb-ba39-4f44f9f79b91 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:46.375918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-aa7f19a4-f050-4edb-ba39-4f44f9f79b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:46.382765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.382765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.382765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.382765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.383574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.383574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.383574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.398689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 314/620] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:46.405339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 307/621] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:46.411683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f19a4-f050-4edb-ba39-4f44f9f79b91 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.422168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f19a4-f050-4edb-ba39-4f44f9f79b91 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.431230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.432310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.432810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.433280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.434338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=3d4b284f0c1348bb9baa47b4c531821e) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.434891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.437006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.448678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 315/622] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/role_assignments?user.id=3d4b284f0c1348bb9baa47b4c531821e&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:46.458671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.472581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb39d74-da99-4b80-8d63-2462b480980c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.482253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.483154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.483442 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.483721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.502094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:46.510235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:46.511914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 308/623] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:46.518802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.541511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d42eb-70a9-42c5-b2c1-f32941413488 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.551372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d3cef-d822-4cd3-b69c-2d9ead0ee7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.552446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d3cef-d822-4cd3-b69c-2d9ead0ee7de admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.552931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d3cef-d822-4cd3-b69c-2d9ead0ee7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.553412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d3cef-d822-4cd3-b69c-2d9ead0ee7de admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.554396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d3cef-d822-4cd3-b69c-2d9ead0ee7de admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.554942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d3cef-d822-4cd3-b69c-2d9ead0ee7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.556858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d3cef-d822-4cd3-b69c-2d9ead0ee7de admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.570983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 316/624] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:46.577646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.597457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb8dd-2da2-41da-8d76-f1783bde91f0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.605116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.606022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.606303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.606575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.627222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.629082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.652954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:46.654492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 309/625] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:46.659911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ee4c-9177-4bec-8c6c-72c38e4dd173 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.660389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.660900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ee4c-9177-4bec-8c6c-72c38e4dd173 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.661619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ee4c-9177-4bec-8c6c-72c38e4dd173 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.664073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 317/626] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:46.671830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b3e8-43de-4215-9651-f73102a53a70 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.672418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b3e8-43de-4215-9651-f73102a53a70 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.672895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b3e8-43de-4215-9651-f73102a53a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.673676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfe7ae-6ee7-4ac8-9f76-54aa8ce9081f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.678299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.679149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.679460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.679735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.680645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.680949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.682812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.697948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 310/627] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:46.702913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-0874b3e8-43de-4215-9651-f73102a53a70 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:46.703780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.704848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0874b3e8-43de-4215-9651-f73102a53a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:46.715198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c62580-3b94-4069-b28a-2da448179e72 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.717515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 318/628] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:46.725465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.726686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.727258 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.727789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.739110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.741699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.743634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b3e8-43de-4215-9651-f73102a53a70 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.753654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b3e8-43de-4215-9651-f73102a53a70 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.760010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.761157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.761643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.762264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.764179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 17 09:34:46.766307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 311/629] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:46.772699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.781723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:46.785648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4f0a5-cdca-402c-baf7-7126ee4ff858 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.789361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:46.790914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.791043 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 319/630] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:46.791942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.792444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.793005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.794060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.794615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.796816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.797303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.807809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2670f0-f5d0-4254-a7c1-decfd0b017cb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.814699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.815733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.816292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.816786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.818398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.819012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.821162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.823159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 312/631] 10.222.0.88 () {56 vars in 1158 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:46.828512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.833608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 320/632] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:46.839515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.841156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeef64-0477-4b60-bfb1-7e7bc6c0ff5d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.850350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.851050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.851333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.851607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.853714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fc5e8-8ddc-48ae-bef9-807dbb3d5b77 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.858668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.859876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.860374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.860847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.864808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.866559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.880949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 313/633] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:34:46.883932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.885392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.886937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.898299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23b87e-81c3-44ab-a078-dbfbe6fc3771 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.911503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.912309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.912594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.912869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.913156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:46.914925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 321/634] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:46.920528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.938466 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c748d0-a6b1-4bcd-b8a1-36c4da074e22 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:46.941676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.943533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.954097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:46.954778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:46.955060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:46.955335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:46.956066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:46.956366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:46.957954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:46.976808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:46.978061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 314/635] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:46.981381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 322/636] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:46.986535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:46.987838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.002618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68e0c4-07c8-4147-abed-17937d0ff925 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.009179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ca76-5a40-4d0c-95e7-1d2d6dd72644 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.013420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.014213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.014484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.014765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.019991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b3384-a501-476a-93c4-4f25c986a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.020642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b3384-a501-476a-93c4-4f25c986a3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.020921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b3384-a501-476a-93c4-4f25c986a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.021192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b3384-a501-476a-93c4-4f25c986a3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.021921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b3384-a501-476a-93c4-4f25c986a3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.022223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b3384-a501-476a-93c4-4f25c986a3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.023858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b3384-a501-476a-93c4-4f25c986a3b9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.032683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.034655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.043600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 315/637] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.045515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343d53-0470-48bf-8101-0c7cde7fd9c4 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.046016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343d53-0470-48bf-8101-0c7cde7fd9c4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.046517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343d53-0470-48bf-8101-0c7cde7fd9c4 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.048537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 316/638] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:47.052676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 17 09:34:47.053430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 323/639] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.054135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.054967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e148-0c7e-49c3-9b87-3083f08d588b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.055427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e148-0c7e-49c3-9b87-3083f08d588b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.055847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e148-0c7e-49c3-9b87-3083f08d588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.064518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d6ac0-e0b7-41f2-887c-c9b315b8c84b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.069325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.070572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.070572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.071051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.076497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4108e148-0c7e-49c3-9b87-3083f08d588b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:47.077868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4108e148-0c7e-49c3-9b87-3083f08d588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:47.079353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.081511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.087144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 317/640] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:47.095835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e148-0c7e-49c3-9b87-3083f08d588b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.096343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:47.097919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 324/641] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.103702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.107264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e148-0c7e-49c3-9b87-3083f08d588b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.112170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.113105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.114192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.114644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.115689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.116145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.118156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.122707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511f105-df2c-4774-9b6f-90755ed74b81 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.131375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.132152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.132432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.132710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.133558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.133867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.136586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.140187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 318/642] 10.222.0.88 () {56 vars in 1158 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.144413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.156555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2019f-f75c-49c7-a452-95c3c44af097 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.160230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 325/643] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.161122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.164116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.165198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.165629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.166066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.171898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e21b91-2050-4944-b200-d230f838f05d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.176741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.177389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.177723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.178052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.179013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:47.186100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:47.186904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.188033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 319/644] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.188955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.193297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.199939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3745446-d171-4546-ae43-95a4b1098c4a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.204373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 326/645] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:47.205019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.207362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.208394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.208894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.209324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.210372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=fc6c69b3efe444c5893683fa61dc9dfc) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.210872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.213497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.215628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbac7d2-abff-45e4-8238-d461072b34d7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.220366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.221082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.221363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.221638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.222240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 320/646] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/role_assignments?user.id=fc6c69b3efe444c5893683fa61dc9dfc&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.222457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.223365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.226972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.228872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.234225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ae03d-c5b5-456f-80c5-868d2da04402 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.244308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 327/647] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.248862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.249891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.250416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.250887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.254529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.277170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311a8f5-9f72-4d58-aa11-dbae57484f19 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.278301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.280517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.302159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:47.303816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 321/648] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.308086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.309272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.310587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.313395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.313890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.330140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7a817-347c-4272-a381-9b953defeca3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.341031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.342169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.343627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.344999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.345434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.346373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.347175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.348190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.351819 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.379870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 322/649] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.382629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:47.384065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 328/650] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.386275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.392717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.404354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb31b40-e6ad-41e7-b99b-2960e85c5f94 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.412171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84806-cd3b-4a09-8f93-e1962580dac7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.415607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.416376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.416726 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.417006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.420515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.421383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.421816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.422235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.423175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.423789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.424877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.425833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.426944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.443023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:47.444551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 323/651] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:47.446454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 329/652] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.452164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.452387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.466492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b439eb0-563d-44e6-b58a-cd4e11a78171 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.468249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac2221-8e0d-4156-a76c-9a73df5966e9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.474448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.475163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.475445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.475716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.476016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.476581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.476888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.477281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.477724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.478164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.478968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.490425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.492706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.493340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 330/653] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.499675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.511869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8dcd-c218-4313-8d59-c173c3ee6dd9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.516586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 17 09:34:47.517067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.517904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.518334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.518621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 324/654] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.518998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.519922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=996e61ee837c4414a6bc725c617cf340) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.520244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.522086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.523503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.534759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 331/655] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/role_assignments?user.id=996e61ee837c4414a6bc725c617cf340&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.536497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496174f9-2cf7-4b82-b194-6cf5ad6a2807 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.543369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.544055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.544338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.544627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.545489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.545799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.547834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.569024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 325/656] 10.222.0.88 () {56 vars in 1160 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.575295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.586717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf69c43-a1f0-400c-834e-500bcff0de5b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.592442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.593111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.593393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.593668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.604186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.606001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.616664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 332/657] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:47.623165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.634170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508b3e9-8960-4cab-ac38-74ece4a2ca69 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.644162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f74b2e-41a7-42cf-8580-ae76cbd2f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.645135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74b2e-41a7-42cf-8580-ae76cbd2f3fd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.645491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74b2e-41a7-42cf-8580-ae76cbd2f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.645872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74b2e-41a7-42cf-8580-ae76cbd2f3fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.659362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f74b2e-41a7-42cf-8580-ae76cbd2f3fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.661532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f74b2e-41a7-42cf-8580-ae76cbd2f3fd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.682787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-48f74b2e-41a7-42cf-8580-ae76cbd2f3fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:47.684489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 326/658] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.690750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.695771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbbd1-f337-4c9d-8258-9d640d7fcda1 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.696051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbbd1-f337-4c9d-8258-9d640d7fcda1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.696322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbbd1-f337-4c9d-8258-9d640d7fcda1 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.699092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 327/659] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:47.703505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb8e91-d212-44c1-9022-4ed73a7f0487 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.704892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5674e-ce12-4990-ac81-a9a2dcb4568a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.705173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5674e-ce12-4990-ac81-a9a2dcb4568a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.705447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5674e-ce12-4990-ac81-a9a2dcb4568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.717790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.718471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.719830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.720109 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.720861 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.721162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.726454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.739941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e8d5674e-ce12-4990-ac81-a9a2dcb4568a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:47.742511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e8d5674e-ce12-4990-ac81-a9a2dcb4568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:47.746554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 333/660] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.752216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.753568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 328/661] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:47.767320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c0565-f7d1-4f2d-ab48-628160a526ad admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.776528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.777347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.777626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.777897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.780495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5674e-ce12-4990-ac81-a9a2dcb4568a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.791154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5674e-ce12-4990-ac81-a9a2dcb4568a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.796076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.798596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.807450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.808255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.808535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.808803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.814047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:47.815860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 334/662] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:47.824729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.836744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:47.840141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5f294-4c04-499d-801f-b757b833d283 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.844708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:47.846410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 329/663] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:47.849815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.850659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.851159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.851566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.852561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.852859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.853192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.855246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.864860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540439-e1ed-4d3d-b822-bd97bd378570 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.869344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 335/664] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.874060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.874060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.874060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.874060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.874407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.874407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.874885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.875800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.886442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6366b13-d007-49a0-8f58-8a18ea11a107 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.886874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 330/665] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:47.892565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.895088 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.896033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.896545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.897007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.898083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=4bc44cadca4c4ac3a3264de0a4641437) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.898673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.900890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.904718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3a95-a429-44c1-8a78-0254e50276ff admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.908792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 336/666] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/role_assignments?user.id=4bc44cadca4c4ac3a3264de0a4641437&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:47.914855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.914855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.914855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.914855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.924318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.926250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.945993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:47.947552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 331/667] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:47.953228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:47.968893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b0865-3c51-486c-8b68-481485e77a4b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:47.974956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:47.975784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:47.976165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:47.976538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:47.977413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:47.977821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:47.980639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:47.997737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 337/668] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:48.003451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:48.014586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416cf7f-7183-4fb2-b7b6-30632921f976 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:48.019630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:48.020630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:48.021010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:48.021383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:48.030310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:48.032907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:48.049166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 17 09:34:48.050920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 332/669] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:48.059226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:48.070095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcb6ec-f01f-4642-b40e-553afb93f49c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:48.075187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:48.076052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:48.076482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:48.076847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:48.077883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:48.078314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:48.080498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:48.110400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 338/670] 10.222.0.88 () {56 vars in 1156 bytes} [Mon Jan 17 09:34:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:48.116114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:48.130756 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5709-76c8-4cfe-8120-b516ad577ac0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:48.141465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:48.142421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:48.142857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:48.143294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:48.157323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:48.159615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:48.178642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:48.180414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 333/671] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:48.185690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:48.198879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfd705-14d0-42d5-a43d-21d8a1fed006 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:48.203831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:48.204771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:48.205201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:48.205675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:48.206568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:48.207090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:48.209087 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:48.227589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 339/672] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:48.234326 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:48.250175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852573-1735-4ab9-8856-bf35c54bfbd4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:48.257285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:48.258861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:48.260072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:48.260694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:48.270943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:48.274533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:48.294181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:48.296129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 334/673] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:48.302237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:48.318222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b30ebb-d05c-49d0-8050-09e37752678c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:48.323848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3f124-f0a1-4021-a2c0-2e2b6a34e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:48.324711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3f124-f0a1-4021-a2c0-2e2b6a34e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:48.325184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3f124-f0a1-4021-a2c0-2e2b6a34e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:48.325613 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3f124-f0a1-4021-a2c0-2e2b6a34e9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:48.328082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3f124-f0a1-4021-a2c0-2e2b6a34e9a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:48.328082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3f124-f0a1-4021-a2c0-2e2b6a34e9a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:48.331228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3f124-f0a1-4021-a2c0-2e2b6a34e9a7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:48.346446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 340/674] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:48.354777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:48.366420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acd88-b28a-448c-bef2-a73881484f28 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:48.372471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93099-8b7b-4a0e-9706-957ed70c987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:48.373600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93099-8b7b-4a0e-9706-957ed70c987d admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:48.374023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93099-8b7b-4a0e-9706-957ed70c987d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:48.374464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93099-8b7b-4a0e-9706-957ed70c987d admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/9c247c8b8bfe484bb39112144317e59c/roles/12b074bcc8b34820b03bcf0073c65b0e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:48.397804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c93099-8b7b-4a0e-9706-957ed70c987d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=9c247c8b8bfe484bb39112144317e59c, role_id=12b074bcc8b34820b03bcf0073c65b0e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:48.401430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c93099-8b7b-4a0e-9706-957ed70c987d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:48.485749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 335/675] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:48 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/9c247c8b8bfe484bb39112144317e59c/roles/12b074bcc8b34820b03bcf0073c65b0e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:49.315693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966933-6dc1-479d-911d-3e4cec409e8c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.316204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966933-6dc1-479d-911d-3e4cec409e8c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.316280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966933-6dc1-479d-911d-3e4cec409e8c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.318269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 341/676] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:49.324438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f9f7-9239-46cf-92b6-96c66fe01fde None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.324869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f9f7-9239-46cf-92b6-96c66fe01fde None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.325073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f9f7-9239-46cf-92b6-96c66fe01fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.359720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5583f9f7-9239-46cf-92b6-96c66fe01fde None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:49.360919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5583f9f7-9239-46cf-92b6-96c66fe01fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:49.442406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 336/677] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:49.488307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966933-6dc1-479d-911d-3e4cec409e8c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.512842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966933-6dc1-479d-911d-3e4cec409e8c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.521616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.522484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.522790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.523065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.536830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:49.544256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:49.550147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 342/678] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:49.551556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f9f7-9239-46cf-92b6-96c66fe01fde None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.563651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f9f7-9239-46cf-92b6-96c66fe01fde None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.574777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.574777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.574777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.574777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.575438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:49.575438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:49.575438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:49.584317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 337/679] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:49.589562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.604381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74e39-bbc4-480f-8304-243dfd421cc5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.612677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.613471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.613750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.614020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.630421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:49.632301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:49.652871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:49.654090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 343/680] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:49.659912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.671006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0acca9-8932-405b-bd89-e9d7ecc3e2ee admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.676361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.677060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.677308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.677584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.678324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:49.678609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:49.680252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:49.693638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 338/681] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:49.699125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.711638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdf776-b217-4d42-b712-919ed38142d8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.718891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.719682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.719961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.720232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.740009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:49.742069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:49.760622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:34:49.765999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 344/682] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:49.767309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.780891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723b50-f9ce-44b0-919b-fea5ba1ba544 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.791473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.792150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.792431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.792703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.793566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:49.793878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:49.795830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:49.817107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 339/683] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:49.822810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.836156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259341ec-8273-45d0-b4ae-1177a293e18c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.847031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.847691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.847964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.848233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.866477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:49.868282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:49.885349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 345/684] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:49.890585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.904167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2197b-fce4-4168-a477-24c1938bbbff admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:49.914057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:49.914892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:49.915176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:49.915477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:49.933297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:49.935179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:49.965421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:49.971138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 340/685] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:49.972121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:49.989165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ce82-fd7c-4503-b318-5f4cac2a2e74 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.004857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0c1f6-7508-41c0-8b18-6e15558214c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.005539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c1f6-7508-41c0-8b18-6e15558214c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.005818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c1f6-7508-41c0-8b18-6e15558214c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.006090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c1f6-7508-41c0-8b18-6e15558214c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.006878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0c1f6-7508-41c0-8b18-6e15558214c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:50.007186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0c1f6-7508-41c0-8b18-6e15558214c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.008786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0c1f6-7508-41c0-8b18-6e15558214c3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.032492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 346/686] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:50.037707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.051842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fefd26-36d5-46e4-b0a3-ac4c6579b96e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.054437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ede471-9d02-4d4f-87ea-f944f7add5d0 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.054870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ede471-9d02-4d4f-87ea-f944f7add5d0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.055257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ede471-9d02-4d4f-87ea-f944f7add5d0 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.057569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 347/687] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:50.062879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84d9e-2f8d-4f06-9a4f-8527c8c91cf1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.063403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84d9e-2f8d-4f06-9a4f-8527c8c91cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.063783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84d9e-2f8d-4f06-9a4f-8527c8c91cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.064397 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.065204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.065575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.065853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.082786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.085044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.090515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-29f84d9e-2f8d-4f06-9a4f-8527c8c91cf1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:50.097703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-29f84d9e-2f8d-4f06-9a4f-8527c8c91cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:50.108174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:50.114759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 348/688] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:50.116183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 341/689] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:50.121609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84d9e-2f8d-4f06-9a4f-8527c8c91cf1 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.136333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84d9e-2f8d-4f06-9a4f-8527c8c91cf1 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.152962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.153962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.154459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.154865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.155812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:50.156370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.158778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.178831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 349/690] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:50.184766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.195813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.198115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7beee2-411c-432d-9650-f9a1b1bdfec0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.213584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.214594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.215114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.215580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.217037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=3d4b284f0c1348bb9baa47b4c531821e) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:50.219421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71756-21b1-42c6-8082-a5054b666758 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.220111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.222268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.234267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.235455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.235960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.236430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.237349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.238611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:50.238611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:50.238611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:50.239416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 342/691] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/role_assignments?user.id=3d4b284f0c1348bb9baa47b4c531821e&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:50.240571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.261301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 17 09:34:50.263222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 350/692] 10.222.0.88 () {56 vars in 1150 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:50.269773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.283402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40f314-79ac-4de8-b022-1f1f5b991287 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.295175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.296278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.296761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.297314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.298244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:50.298781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.300069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:50.300069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:50.300069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:50.301473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69c595-cade-4308-ba3d-b62186af04af admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.308228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 343/693] 10.222.0.88 () {56 vars in 1145 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:50.315227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.329411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b71d1-c83c-464c-9645-08d57cd24180 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.338664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.339379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.339657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.339927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.340727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:50.340978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.342169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:50.342169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:50.342169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:50.343093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfafa-660b-4bbc-a26a-70693ada1ab3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.356548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 351/694] 10.222.0.88 () {56 vars in 1145 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:50.599754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cdf40-a196-44b9-84b8-94770667dbfc None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.600248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cdf40-a196-44b9-84b8-94770667dbfc None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.600248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cdf40-a196-44b9-84b8-94770667dbfc None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.602289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 344/695] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:50.608690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87ffa-4429-4aa9-a35f-471977b97283 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.608979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87ffa-4429-4aa9-a35f-471977b97283 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.609243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87ffa-4429-4aa9-a35f-471977b97283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.629808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ebb87ffa-4429-4aa9-a35f-471977b97283 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:50.631102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ebb87ffa-4429-4aa9-a35f-471977b97283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:50.640319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 352/696] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:50.670214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cdf40-a196-44b9-84b8-94770667dbfc None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.686573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cdf40-a196-44b9-84b8-94770667dbfc None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.692481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.693296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.693575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.693843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.708894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.710752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.733233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:50.734919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 345/697] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:50.740877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb87ffa-4429-4aa9-a35f-471977b97283 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.751152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb87ffa-4429-4aa9-a35f-471977b97283 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.763771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8232583-c7a0-4602-ba36-792361596f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.764637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8232583-c7a0-4602-ba36-792361596f0c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.765022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8232583-c7a0-4602-ba36-792361596f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.765396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8232583-c7a0-4602-ba36-792361596f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.766256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8232583-c7a0-4602-ba36-792361596f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:50.766663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8232583-c7a0-4602-ba36-792361596f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.768417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8232583-c7a0-4602-ba36-792361596f0c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.781835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 353/698] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:50.787692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.802200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646afaa-b8fe-4771-a112-9a94c966c728 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:50.811182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:50.811862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.812143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.812417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.813150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:50.815099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:50.924175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10ff7-ce4a-4e3f-b22a-a58c6ac55b22 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.924640 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10ff7-ce4a-4e3f-b22a-a58c6ac55b22 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.925041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10ff7-ce4a-4e3f-b22a-a58c6ac55b22 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.927192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 354/699] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:50.932708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf1da2-4d8d-4899-bf57-52aff7ef0713 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:50.933137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf1da2-4d8d-4899-bf57-52aff7ef0713 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:50.933516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf1da2-4d8d-4899-bf57-52aff7ef0713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:50.952766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6acf1da2-4d8d-4899-bf57-52aff7ef0713 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:50.954181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6acf1da2-4d8d-4899-bf57-52aff7ef0713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:50.962767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 355/700] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:50.979476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 346/701] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:34:50 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:50.988471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf1da2-4d8d-4899-bf57-52aff7ef0713 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:50.999823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf1da2-4d8d-4899-bf57-52aff7ef0713 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.005882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.007075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.007462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.007842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.008679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.010858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.024144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 17 09:34:51.025791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 356/702] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:50 2022] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:51.032279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.053159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb35b-efef-4d58-966a-78578489d5fb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.058572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6716a19-eda3-4a57-a04a-f8c945a99320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.059419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6716a19-eda3-4a57-a04a-f8c945a99320 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.059704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6716a19-eda3-4a57-a04a-f8c945a99320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.059982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6716a19-eda3-4a57-a04a-f8c945a99320 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.060730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6716a19-eda3-4a57-a04a-f8c945a99320 admin admin] RBAC: Adding query filter params (name=network) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:51.061033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6716a19-eda3-4a57-a04a-f8c945a99320 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.062762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6716a19-eda3-4a57-a04a-f8c945a99320 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.077081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 347/703] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:51.083553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.094623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416fea4-ae4b-4639-b26c-53228200b4e4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.106929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc0f51-1814-452f-89e9-d3bb0ff6229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.108006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0f51-1814-452f-89e9-d3bb0ff6229f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.108462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0f51-1814-452f-89e9-d3bb0ff6229f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.108957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0f51-1814-452f-89e9-d3bb0ff6229f admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.109965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc0f51-1814-452f-89e9-d3bb0ff6229f admin admin] RBAC: Adding query filter params (type=network) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:51.110512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc0f51-1814-452f-89e9-d3bb0ff6229f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.112471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc0f51-1814-452f-89e9-d3bb0ff6229f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.118085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 357/704] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:51.503557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f8ba-6c81-4672-bf3a-0518326e64f7 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.503953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f8ba-6c81-4672-bf3a-0518326e64f7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.504140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f8ba-6c81-4672-bf3a-0518326e64f7 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.506207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 348/705] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:51.511639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4df88-54c0-4f7a-8d13-4182f8eb9f9a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.512120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4df88-54c0-4f7a-8d13-4182f8eb9f9a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.512217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4df88-54c0-4f7a-8d13-4182f8eb9f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.538281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-dcb4df88-54c0-4f7a-8d13-4182f8eb9f9a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:51.539488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-dcb4df88-54c0-4f7a-8d13-4182f8eb9f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:51.551700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 358/706] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:51.575083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f8ba-6c81-4672-bf3a-0518326e64f7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.593571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f8ba-6c81-4672-bf3a-0518326e64f7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.602419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.603950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.604234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.604509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.622164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:51.629184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:51.630811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 349/707] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:51.637259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4df88-54c0-4f7a-8d13-4182f8eb9f9a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.656296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4df88-54c0-4f7a-8d13-4182f8eb9f9a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.667448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.668136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.668411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.668679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.669451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:51.669753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.671670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.685482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 359/708] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:51.690937 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.706650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a6809-d174-4e5a-b1a6-a8219f7a5bf0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.720355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.721161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.721441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.721711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.740890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.742762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.767042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:51.768310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 350/709] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:51.775285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.792139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634146-4585-4717-89a3-c7cd97ed5fe0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.799137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.800169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.800658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.801131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.802079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:51.802608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.804531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.825424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 360/710] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:51.830716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.843720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174578c-7b09-412f-bd35-3fb597f3bb8a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.851313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.852182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.852460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.852751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.867911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.870067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.889535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 17 09:34:51.890813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 351/711] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:51.896362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.912132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96320186-085e-4d98-bd66-ca8d949a2bd7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.923415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.924364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.924853 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.925362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:51.926419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:51.926972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:51.929075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:51.958024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 361/712] 10.222.0.88 () {56 vars in 1156 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:51.964326 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:51.977855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edaf4b-841b-4de4-81c0-39311f61b725 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:51.986619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:51.987405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:51.987687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:51.987960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:52.003226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:52.004981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:52.020567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 352/713] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:34:52.026631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:52.043765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3a0b-f375-43ce-8c8a-31a280530ab6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:52.059377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:52.060502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:52.060989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:52.061481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:52.078680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:52.080924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:52.106410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:52.107991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 362/714] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:52.113467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:52.127753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10671d3d-25ef-4e3a-8f45-b8638c93ec6c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:52.143304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:52.143953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:52.144237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:52.144508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:52.145245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:52.145549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:52.147178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:52.163229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 353/715] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:52.169259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:52.184688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e29954-8798-49ee-b505-8334df891f1c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:52.194959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:52.196096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:52.197187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:52.197671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:52.210023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:52.212423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:52.228257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:52.229804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 363/716] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:52.235816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:52.248347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad8926-6a39-4e25-ab26-8d6f0782d034 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:52.253516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7942b5-db3c-460f-a9ab-0130b8c59598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:52.254227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7942b5-db3c-460f-a9ab-0130b8c59598 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:52.254508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7942b5-db3c-460f-a9ab-0130b8c59598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:52.254803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7942b5-db3c-460f-a9ab-0130b8c59598 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:52.255662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7942b5-db3c-460f-a9ab-0130b8c59598 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:52.255965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7942b5-db3c-460f-a9ab-0130b8c59598 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:52.257865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7942b5-db3c-460f-a9ab-0130b8c59598 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:52.279244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 354/717] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:52.285329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:52.296610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ae98-ff8c-4b6e-b626-1a3017c370cb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:52.306619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16cd4c-ca74-4956-a24e-61c858b1d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:52.307350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16cd4c-ca74-4956-a24e-61c858b1d2ea admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:52.307624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16cd4c-ca74-4956-a24e-61c858b1d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:52.307935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16cd4c-ca74-4956-a24e-61c858b1d2ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:52.308890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16cd4c-ca74-4956-a24e-61c858b1d2ea admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=9c247c8b8bfe484bb39112144317e59c) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:52.309194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16cd4c-ca74-4956-a24e-61c858b1d2ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:52.311142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16cd4c-ca74-4956-a24e-61c858b1d2ea admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:52.318266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 364/718] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:52 2022] GET /identity/v3/role_assignments?user.id=9c247c8b8bfe484bb39112144317e59c&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:52.977534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deac72-c5da-4633-ad17-2bd32efa6938 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:52.978645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deac72-c5da-4633-ad17-2bd32efa6938 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:52.978724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deac72-c5da-4633-ad17-2bd32efa6938 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:52.980516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 355/719] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:52.986242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b8d9-fbde-492a-8655-22edbb90cb98 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:52.986662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b8d9-fbde-492a-8655-22edbb90cb98 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:52.986905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b8d9-fbde-492a-8655-22edbb90cb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.005818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-18f1b8d9-fbde-492a-8655-22edbb90cb98 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:53.007132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-18f1b8d9-fbde-492a-8655-22edbb90cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:53.019441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 365/720] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 17 09:34:53.045134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deac72-c5da-4633-ad17-2bd32efa6938 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.057530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deac72-c5da-4633-ad17-2bd32efa6938 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.061936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.062713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.063017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.063283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.069096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d095392-49fb-4ae8-b1ed-8c06cfa96944 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.069370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d095392-49fb-4ae8-b1ed-8c06cfa96944 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.069637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d095392-49fb-4ae8-b1ed-8c06cfa96944 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.071671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 366/721] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:53.075084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:53.077973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d17c-b00b-4706-ba94-cbd902d2a148 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.078248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d17c-b00b-4706-ba94-cbd902d2a148 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.078519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d17c-b00b-4706-ba94-cbd902d2a148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.083957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:53.085675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 356/722] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:53.092043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.098615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-cb67d17c-b00b-4706-ba94-cbd902d2a148 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:53.099377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-cb67d17c-b00b-4706-ba94-cbd902d2a148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:53.103826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b450b-08bc-4225-977d-9f3186a77f89 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.109554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 367/723] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 17 09:34:53.116389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.117063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.117345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.117620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.118420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:53.118743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.120409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.132763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d17c-b00b-4706-ba94-cbd902d2a148 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.142587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d17c-b00b-4706-ba94-cbd902d2a148 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.145467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 357/724] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:53.147740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.148403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.148681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.148951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.150225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.151413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:53.151413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:53.151413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:53.152255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.152358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.168917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a01b2-5881-4b5d-8da2-47b32c1f3450 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.173818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.174665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.174997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.175271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.186767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.188605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.207444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:53.209010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 358/725] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:53.215119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.225832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1e8c4-eb48-4e57-a928-c8ba867098e5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.231025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.231961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.232462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.233050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.234074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:53.234589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.236568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.249898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 359/726] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:53.255572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.266423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34204e7-37cb-4e1e-9dd4-0809aa405919 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.271439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.272548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.273092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.273645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.283237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.285579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.299955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:34:53.301807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 360/727] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:53.307519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.308502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 368/728] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:34:53 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:34:53.319031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07f022-f9f8-4ef3-b8ee-59e9cf53b932 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.348064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.349158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.349656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.350141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.351295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:53.351806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.353997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.374545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 361/729] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:53.380094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.391567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f238b3-2402-4ee6-a05f-c08a83a76676 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.396272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.397065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.397436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.397708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.411354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.413272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.431142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:53.432720 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 369/730] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:53.438363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.449116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeeeda-e8a3-4ec0-ad92-d4536c62187c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.453939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.454608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.454947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.455220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.455955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:53.456300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.457893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.471757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 362/731] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:53.477225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.487822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6101a-b9eb-4d0d-a162-c0881241249c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.492520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.493344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.493632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.493948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.501832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.503888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.527405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:53.528745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 370/732] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:53.535027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.545568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c454f9-5d2c-47f0-abb7-c21501020f91 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.555533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12062ecc-c4b9-46d2-8d6c-bb6df07e1b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.556780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12062ecc-c4b9-46d2-8d6c-bb6df07e1b49 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.557061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12062ecc-c4b9-46d2-8d6c-bb6df07e1b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.557335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12062ecc-c4b9-46d2-8d6c-bb6df07e1b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.558209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12062ecc-c4b9-46d2-8d6c-bb6df07e1b49 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:53.558517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12062ecc-c4b9-46d2-8d6c-bb6df07e1b49 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.560573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12062ecc-c4b9-46d2-8d6c-bb6df07e1b49 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.580990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 363/733] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:53.586873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:53.598002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd739aa-46b3-4045-9803-d4a758ed6239 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:53.602890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8a287-6533-4a8b-abfe-12a01a6174ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:53.603776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a287-6533-4a8b-abfe-12a01a6174ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.604149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a287-6533-4a8b-abfe-12a01a6174ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.604464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a287-6533-4a8b-abfe-12a01a6174ca admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/3d4b284f0c1348bb9baa47b4c531821e/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.606507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8a287-6533-4a8b-abfe-12a01a6174ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=3d4b284f0c1348bb9baa47b4c531821e, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:53.609293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8a287-6533-4a8b-abfe-12a01a6174ca admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:53.692149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 371/734] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:53 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/3d4b284f0c1348bb9baa47b4c531821e/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:53.866245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ac8f1-4c9f-465f-857c-38d96d87b3b7 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.866547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ac8f1-4c9f-465f-857c-38d96d87b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.866741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ac8f1-4c9f-465f-857c-38d96d87b3b7 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.869487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 364/735] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:53.874859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8ac92-f957-43fa-a7bc-3b0677ddac64 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:53.875148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8ac92-f957-43fa-a7bc-3b0677ddac64 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:53.875421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8ac92-f957-43fa-a7bc-3b0677ddac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:53.895727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-daf8ac92-f957-43fa-a7bc-3b0677ddac64 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:53.896957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-daf8ac92-f957-43fa-a7bc-3b0677ddac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:53.962514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 372/736] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:53 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:34:53.988010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ac8f1-4c9f-465f-857c-38d96d87b3b7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.006212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ac8f1-4c9f-465f-857c-38d96d87b3b7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.010831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.011493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.011779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.012055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.012792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.013816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:54.013816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:54.013816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:54.014692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.086270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0d22-4cac-45b6-835a-ae62df34e617 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.086804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0d22-4cac-45b6-835a-ae62df34e617 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.087072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0d22-4cac-45b6-835a-ae62df34e617 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.088988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 373/737] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:54.098682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 365/738] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:34:53 2022] POST /identity/v3/services => generated 240 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:34:54.102596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497fc92-10c2-40c0-88a8-b3a1acec9b29 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.103431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497fc92-10c2-40c0-88a8-b3a1acec9b29 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.103711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497fc92-10c2-40c0-88a8-b3a1acec9b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.136140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1497fc92-10c2-40c0-88a8-b3a1acec9b29 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:54.137384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1497fc92-10c2-40c0-88a8-b3a1acec9b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:54.165090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 374/739] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:54 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:34:54.209021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.224884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556af7c-cbc8-457c-8228-a8ac5ffba4d0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.233133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.234007 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.234291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.234609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.252151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:54.259967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:54.261559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 366/740] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:54.267617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497fc92-10c2-40c0-88a8-b3a1acec9b29 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.278087 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497fc92-10c2-40c0-88a8-b3a1acec9b29 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.286794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.287493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.287827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.288110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.288894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:54.289202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.290950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.304942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 375/741] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:54.311735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.325801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff71ee-8ce0-4fb0-84d9-9b3957f6d184 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.332940 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.333761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.334045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.334315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.352311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.354243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.379594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:54.381348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 367/742] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:54.387539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.397972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79452faf-e08d-4c7c-8e82-ebebd75b17f9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.406518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.407791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.408343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.408831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.409876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:54.410386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.412319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.430651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 376/743] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:54.436265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.448784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911106ef-c786-4361-80f3-55f2abda7c4f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.455273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.456095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.456380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.456655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.468200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.470239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.490539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 17 09:34:54.493808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 368/744] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:54.499332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.513167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15ff17-c069-44a3-996c-f1d3367ad606 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.522536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.523560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.524058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.524616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.525677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:54.526146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.532580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.554780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 377/745] 10.222.0.88 () {56 vars in 1170 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:54.560845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.576463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3754-1425-4d57-9c67-c6858a647839 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.594780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.595884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.596359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.596846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.616904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.620753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.646391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 369/746] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:34:54.651792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.666722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dbfb-9c87-4555-b372-5ef504c1d3e1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.675862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.676933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.677392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.677890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.694700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.696921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.721564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:54.723089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 378/747] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:54.732431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.755652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331b83e-04c3-416e-a2e3-065c3a2179b3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.771487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.772624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.773120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.773635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.775059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:54.775611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.778646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.808239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 370/748] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:54.815951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.832232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f4a0-74d0-4c31-8d27-ca491a737ef1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.841226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.842305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.842862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.843404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.858932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.861183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.877710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:54.879290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 379/749] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:54.888693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.908466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0c263-eb2c-4703-be68-69b93f5a2892 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.913016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1a707-9f40-4458-8513-15e2eed0495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.913678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a707-9f40-4458-8513-15e2eed0495c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.913941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a707-9f40-4458-8513-15e2eed0495c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.914218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a707-9f40-4458-8513-15e2eed0495c admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.915034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1a707-9f40-4458-8513-15e2eed0495c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:54.915845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1a707-9f40-4458-8513-15e2eed0495c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.917673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1a707-9f40-4458-8513-15e2eed0495c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.930334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 371/750] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:54.936801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:54.947930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4759e00-874c-408b-8613-4026399e41ab admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:54.952603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9530c8-8df9-4718-8d48-82e5bed14782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:54.953429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9530c8-8df9-4718-8d48-82e5bed14782 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:54.953704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9530c8-8df9-4718-8d48-82e5bed14782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:54.953969 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9530c8-8df9-4718-8d48-82e5bed14782 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:54.954897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9530c8-8df9-4718-8d48-82e5bed14782 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=5a93d97f27354602aa778cea8d184455) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:54.955201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9530c8-8df9-4718-8d48-82e5bed14782 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:54.957181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9530c8-8df9-4718-8d48-82e5bed14782 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:54.963765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 380/751] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:54 2022] GET /identity/v3/role_assignments?user.id=5a93d97f27354602aa778cea8d184455&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:55.496057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08500eb4-f046-4af1-9b32-685366c496c7 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.496565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08500eb4-f046-4af1-9b32-685366c496c7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.496669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08500eb4-f046-4af1-9b32-685366c496c7 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.498692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 372/752] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:55.504591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8825a4-2468-4632-bec4-4cb93f6c4a43 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.505055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8825a4-2468-4632-bec4-4cb93f6c4a43 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.505131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8825a4-2468-4632-bec4-4cb93f6c4a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.531752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6a8825a4-2468-4632-bec4-4cb93f6c4a43 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:55.533204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6a8825a4-2468-4632-bec4-4cb93f6c4a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:55.541499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 381/753] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:55 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:34:55.579248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08500eb4-f046-4af1-9b32-685366c496c7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:55.596654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08500eb4-f046-4af1-9b32-685366c496c7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:55.603712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:55.604517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.604793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.605061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.623843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:55.631725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:55.634493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 373/754] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:55.639576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8825a4-2468-4632-bec4-4cb93f6c4a43 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:55.652553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8825a4-2468-4632-bec4-4cb93f6c4a43 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:55.663039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:55.663722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.663998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.664268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.665041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:55.665373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:55.671121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:55.681007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 382/755] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:55.686634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:55.700506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275304fb-6987-4d65-8b25-e1d22e7d20e0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:55.709209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:55.710515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.710925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.711409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.734776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:55.736858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:55.766951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:55.768496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 374/756] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:55.773986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:55.789337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc109a-a178-4da1-8e4a-6c92a7d1f0a9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:55.804341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:55.805142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.805423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.806273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.807053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:55.807356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:55.809076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:55.829186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 383/757] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:55.835000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:55.848868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034505c9-2255-4c68-ab25-9f554463949f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:55.855718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:55.856568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.856847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.857168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.880114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:55.882173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:55.903007 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 17 09:34:55.904557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 375/758] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:55.910400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:55.920621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be7cf0-9349-4243-b6e7-c55c3e4eb9c5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:55.932635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:55.933354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.933630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.933944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:55.935002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:55.935264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:55.937163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:55.967763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 384/759] 10.222.0.88 () {56 vars in 1156 bytes} [Mon Jan 17 09:34:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:55.973425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:55.989406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be80e4-d0f0-4d8a-9b65-c955fe4006dd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:55.997654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:55.998432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:55.998712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:55.999042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.012132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.014089 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.028637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 376/760] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:55 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:34:56.034465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.044487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aa828-6661-438a-b255-97fb078d53ad admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.049368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.050205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.050562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.050873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.062605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.064576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.084768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:56.086305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 385/761] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:56.092365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.104210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761331-050f-49bb-a751-ab17274f1f4e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.108929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.109648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.109996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.110330 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.111166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.111467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.113127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.131945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 377/762] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:56.138259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.149376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadee29-dd8b-43ba-8676-0a8262dab83b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.164029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.164835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.165765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.166048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.178924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.181447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.205114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:56.207799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 386/763] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:56.213156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.234363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e9449-a726-4f62-8b3d-4c9392816bf4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.244264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cb409-69ea-4a26-9acb-b5b016920dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.245523 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb409-69ea-4a26-9acb-b5b016920dab admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.245837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb409-69ea-4a26-9acb-b5b016920dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.246200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cb409-69ea-4a26-9acb-b5b016920dab admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.247037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb409-69ea-4a26-9acb-b5b016920dab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.247343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb409-69ea-4a26-9acb-b5b016920dab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.249526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cb409-69ea-4a26-9acb-b5b016920dab admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.268295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 378/764] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:56.274961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.297550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca9f7c-0c3b-4a6f-bdce-1e90ea6dedc6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.307482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244159-57a4-432c-80cd-1d27f54683ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.308534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244159-57a4-432c-80cd-1d27f54683ea admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.309015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244159-57a4-432c-80cd-1d27f54683ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.309511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244159-57a4-432c-80cd-1d27f54683ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.310580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244159-57a4-432c-80cd-1d27f54683ea admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=9c247c8b8bfe484bb39112144317e59c) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.311153 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244159-57a4-432c-80cd-1d27f54683ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.313440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244159-57a4-432c-80cd-1d27f54683ea admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.327677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 387/765] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/role_assignments?user.id=9c247c8b8bfe484bb39112144317e59c&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:56.450185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96cdad-4872-4ced-bc66-4f5fad26d568 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.450531 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96cdad-4872-4ced-bc66-4f5fad26d568 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.450754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96cdad-4872-4ced-bc66-4f5fad26d568 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.453020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 379/766] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:56.458309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad6c17-6ee4-4888-b979-93d47c895c7c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.458898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad6c17-6ee4-4888-b979-93d47c895c7c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.459376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad6c17-6ee4-4888-b979-93d47c895c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.484104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-44ad6c17-6ee4-4888-b979-93d47c895c7c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:56.485687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-44ad6c17-6ee4-4888-b979-93d47c895c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:56.497869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 388/767] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:56 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:34:56.521652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96cdad-4872-4ced-bc66-4f5fad26d568 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.547579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96cdad-4872-4ced-bc66-4f5fad26d568 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.552259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b834200-6330-4e0f-933e-ff171394df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.553051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b834200-6330-4e0f-933e-ff171394df6f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.553325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b834200-6330-4e0f-933e-ff171394df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.553589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b834200-6330-4e0f-933e-ff171394df6f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.571142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b834200-6330-4e0f-933e-ff171394df6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:56.578543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-0b834200-6330-4e0f-933e-ff171394df6f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:56.580260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 380/768] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:56.585705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad6c17-6ee4-4888-b979-93d47c895c7c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.602618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad6c17-6ee4-4888-b979-93d47c895c7c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.611003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.611965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.612409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.613285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.613847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.614324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.616147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.627864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 389/769] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:56.628600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db896512-5292-41b6-8639-a1f3b67e8133 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.629012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db896512-5292-41b6-8639-a1f3b67e8133 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.629357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db896512-5292-41b6-8639-a1f3b67e8133 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.631459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 381/770] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:34:56.635703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.643001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c9f1-b351-454f-a788-4d0762cd435d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.643356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c9f1-b351-454f-a788-4d0762cd435d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.643718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c9f1-b351-454f-a788-4d0762cd435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.647209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5371432-409a-48b6-ae05-d5b8e24eabd5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.652963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.654020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.654471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.654945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.667071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.669272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.675735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8e91c9f1-b351-454f-a788-4d0762cd435d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:56.677003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8e91c9f1-b351-454f-a788-4d0762cd435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:56.689358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:56.691443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 390/771] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:56.695959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 382/772] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:56 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:34:56.696691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.714407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ddebd-7944-45b3-b71b-a37dd33ad5d6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.722575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.723494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.724022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.724596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.725524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.726064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.728581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.746478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 391/773] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:56.751721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c9f1-b351-454f-a788-4d0762cd435d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.755470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.765381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a1c2f-21db-4a0f-9928-cebf22f39c11 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.765813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c9f1-b351-454f-a788-4d0762cd435d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.777991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.780196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.781151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.781652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.783183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.784062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.784444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.785059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.786887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.787447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.799553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.805849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.812195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 17 09:34:56.814042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 392/774] 10.222.0.88 () {56 vars in 1150 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:56.819918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.831331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:34:56.832926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 383/775] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:56.837688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ce5f-9b7d-448b-8e4a-9aace8cab020 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.840765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.850020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.851154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.851863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.852552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.854166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.855239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.858654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.864093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce5f6-a00b-45ed-ac0b-f825b5282b0a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.868574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 393/776] 10.222.0.88 () {56 vars in 1145 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:56.872251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.873194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.874660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.875297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.876141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.881091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.881677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.884698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.891252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da8255-4814-48e3-b962-9868ba558ca3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.902220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.904592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.905188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.905831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.907849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.908722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.910608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.923027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 394/777] 10.222.0.88 () {56 vars in 1145 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:56.926014 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 384/778] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:56.929760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.935167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:56.945079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bb24a-463d-4113-8f70-ce37203f4c41 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.950555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236f69b-5a81-40d1-aab2-11a2abccd6b6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:56.956432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.957689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.957974 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.959211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.960991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] RBAC: Adding query filter params (interface=public, service_id=598d7b38d0ba497188962e8e4bee1db8, region_id=RegionOne) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:56.961309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.962098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:56.963697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:56.963697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:34:56.963697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:34:56.964576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:56.964856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:56.965184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:56.966185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.980698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:56.983893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:56.989512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 395/779] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/endpoints?service_id=598d7b38d0ba497188962e8e4bee1db8&interface=public®ion_id=RegionOne => generated 194 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:56.990515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.008438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312971f2-fd29-4014-84a6-75c705cad6d3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.009479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 385/780] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:34:57.013622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.019309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.019957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.020437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.020714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.021417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.025891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.027977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43934999-18e4-435a-87fe-363d9d5302b0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.038049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524a4a3-7d0a-4cf8-b966-f8a43ee48103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.039684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524a4a3-7d0a-4cf8-b966-f8a43ee48103 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.039862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 396/781] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:34:56 2022] GET /identity/v3/services => generated 772 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:57.040099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524a4a3-7d0a-4cf8-b966-f8a43ee48103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.040383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524a4a3-7d0a-4cf8-b966-f8a43ee48103 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.064153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524a4a3-7d0a-4cf8-b966-f8a43ee48103 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.066423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524a4a3-7d0a-4cf8-b966-f8a43ee48103 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.090242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-d524a4a3-7d0a-4cf8-b966-f8a43ee48103 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:57.092280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 386/782] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:57.098787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.117560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c55ffe-292a-413c-bd8a-a2b433be88ab admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.127067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.127757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.128089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.128334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.129377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:57.129916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.133048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.159277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507fae-fc8f-4949-9e71-f8089b3722ee None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.160111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507fae-fc8f-4949-9e71-f8089b3722ee None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.160886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507fae-fc8f-4949-9e71-f8089b3722ee None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.161194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 397/783] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:57.165134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 387/784] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:57.166345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.170841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa3ba-7e40-4eea-9eaa-dbcb0ed2e40e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.171648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa3ba-7e40-4eea-9eaa-dbcb0ed2e40e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.172387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa3ba-7e40-4eea-9eaa-dbcb0ed2e40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.180135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48eeb-6301-47f3-bedc-e2a343a047a5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.195396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.196214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.197027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.197302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.201097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-deeaa3ba-7e40-4eea-9eaa-dbcb0ed2e40e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:57.203530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-deeaa3ba-7e40-4eea-9eaa-dbcb0ed2e40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:57.210229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.212920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.218035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 388/785] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:57 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:34:57.241579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:57.243202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 398/786] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:34:57.246707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa3ba-7e40-4eea-9eaa-dbcb0ed2e40e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.252195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.268669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa3ba-7e40-4eea-9eaa-dbcb0ed2e40e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.270298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e932bd-f34e-421c-9041-f6cd406e1133 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.278649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.280107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.280866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.281628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.282268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.282638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.283102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.283478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] PATH_INFO: `/v3/services/network` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.284384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:57.285154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.285566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.286704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:57.286704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:57.286704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:57.290618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.290759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.301992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 399/787] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:57.306656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 17 09:34:57.307920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.308592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 389/788] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/services/network => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:57.315709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.318810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640b50-fd08-4907-9d58-634ef57a43a3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.327011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.327944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a0a91-b1f9-40ab-855a-ab3c0a6e6820 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.328082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.328558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.328999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.330317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=3d4b284f0c1348bb9baa47b4c531821e) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:57.330884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.332943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.333370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.334235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.334621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.335061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.336235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] RBAC: Adding query filter params (name=network) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:57.336643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.338577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.343829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 400/789] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/role_assignments?user.id=3d4b284f0c1348bb9baa47b4c531821e&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:57.349275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 390/790] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:57.350545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.363631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece9b12-4586-44de-a115-8ed9c0f5494e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.375612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.376498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.376934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.377389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.378245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] RBAC: Adding query filter params (type=network) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:57.378708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.380669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.388432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 401/791] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:57.394239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.404784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae36b-b988-4669-b054-daad37ef5de2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.409960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.410643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.410964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.411243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.412060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] RBAC: Adding query filter params (interface=public, service_id=e31f4c9ff018494d8e4c55be5f2736cb, region_id=RegionOne) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:57.412372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.413399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:34:57.413399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:34:57.413399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:34:57.414278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4875f-d2dc-452c-82d5-0ba56dafb61f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.423155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 391/792] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/endpoints?service_id=e31f4c9ff018494d8e4c55be5f2736cb&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:57.428557 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.439660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29b5c-dde3-445c-8dae-71ae2981d3ea admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.444554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61af3e-917e-41a0-91ec-e251b4532444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.445281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61af3e-917e-41a0-91ec-e251b4532444 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.445564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61af3e-917e-41a0-91ec-e251b4532444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.445896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61af3e-917e-41a0-91ec-e251b4532444 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.447262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61af3e-917e-41a0-91ec-e251b4532444 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.448933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61af3e-917e-41a0-91ec-e251b4532444 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.455160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 402/793] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:57.838523 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3974745-ffe2-4dc8-af1b-13b1f6d2a870 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.839068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3974745-ffe2-4dc8-af1b-13b1f6d2a870 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.839068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3974745-ffe2-4dc8-af1b-13b1f6d2a870 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.840836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 392/794] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:57.847213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2887ccf-43de-40f4-8103-2cf3aa849fd4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.847671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2887ccf-43de-40f4-8103-2cf3aa849fd4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.847754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2887ccf-43de-40f4-8103-2cf3aa849fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.871734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d2887ccf-43de-40f4-8103-2cf3aa849fd4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:57.872945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d2887ccf-43de-40f4-8103-2cf3aa849fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:57.881191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 403/795] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:57 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:34:57.906266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3974745-ffe2-4dc8-af1b-13b1f6d2a870 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.925353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3974745-ffe2-4dc8-af1b-13b1f6d2a870 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.929951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.931361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.931639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.931908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.947637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:57.954583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:34:57.956106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 393/796] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:57.961631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2887ccf-43de-40f4-8103-2cf3aa849fd4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:57.974240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2887ccf-43de-40f4-8103-2cf3aa849fd4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:57.982825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:57.983493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:57.983776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:57.984038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:57.984806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:57.985109 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:57.986707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:57.999262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 404/797] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:58.004467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.019083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602576-f755-4972-a2d7-a4b59b91af9f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.027380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.028174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.028451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.028722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.046160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.048091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.067207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:58.068778 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 394/798] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:58.073980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.092446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574fcb7-60d6-462f-bccc-e871bcf96716 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.103580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.104251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.104531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.104801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.105539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:58.105844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.107742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.128780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 405/799] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:58.133960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.147392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf3523-4cc6-48ba-9786-f16c0d426c10 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.154137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.155048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.155331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.155601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.172188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.174510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.194930 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 17 09:34:58.197183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 395/800] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:58.202569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.218306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f4e4-cf3c-4f1a-8aa3-2404cb4b4e5c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.229674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.230356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.231215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.231564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.232456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:58.232776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.234641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.264913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 406/801] 10.222.0.88 () {56 vars in 1170 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:58.270374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.284743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf987a2-4c51-400b-ae29-a9443921ee6c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.292520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.293365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.293807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.294127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.306086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.308006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.329348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:58.330791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 396/802] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:58.337886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.357146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da108e3d-e62b-42cd-a592-07047f984e5e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.376350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.377306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.377810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.378287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.379281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:58.379800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.381599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.397426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 407/803] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:58.403221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.421335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f530-e53f-4c33-9b94-07251e58db20 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.427932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.428778 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.429059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.429331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.440403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.442659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.464722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:58.466271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 397/804] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:58.471638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.487754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea83f-81eb-440f-b1db-38dccdadf7cc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.498916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2a35e-440d-4935-ad55-981d3b8e1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.499889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a35e-440d-4935-ad55-981d3b8e1150 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.500395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a35e-440d-4935-ad55-981d3b8e1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.500865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a35e-440d-4935-ad55-981d3b8e1150 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.501917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2a35e-440d-4935-ad55-981d3b8e1150 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:58.502452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2a35e-440d-4935-ad55-981d3b8e1150 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.504547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2a35e-440d-4935-ad55-981d3b8e1150 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.521912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 408/805] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:58.528263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:58.542348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26941c-9e79-42fe-8c21-6bf6ee858840 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:58.548182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554a600-f7c2-4a9f-8960-cef068483325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:58.549130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554a600-f7c2-4a9f-8960-cef068483325 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.549411 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554a600-f7c2-4a9f-8960-cef068483325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.549738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554a600-f7c2-4a9f-8960-cef068483325 admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/5a93d97f27354602aa778cea8d184455/roles/12b074bcc8b34820b03bcf0073c65b0e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.570268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554a600-f7c2-4a9f-8960-cef068483325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=5a93d97f27354602aa778cea8d184455, role_id=12b074bcc8b34820b03bcf0073c65b0e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:58.573530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554a600-f7c2-4a9f-8960-cef068483325 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:58.697511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 398/806] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:58 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/5a93d97f27354602aa778cea8d184455/roles/12b074bcc8b34820b03bcf0073c65b0e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:58.976732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94ee2e-de94-4de8-81e9-9829d78da7c5 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.977744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94ee2e-de94-4de8-81e9-9829d78da7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.978238 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94ee2e-de94-4de8-81e9-9829d78da7c5 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:58.980490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 409/807] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:58.986915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d38b3-351e-49fa-bc22-6a265492736b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:58.987812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d38b3-351e-49fa-bc22-6a265492736b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:58.988305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d38b3-351e-49fa-bc22-6a265492736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.008568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-1f0d38b3-351e-49fa-bc22-6a265492736b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:59.010787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1f0d38b3-351e-49fa-bc22-6a265492736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:34:59.082792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 399/808] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:58 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:34:59.115608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94ee2e-de94-4de8-81e9-9829d78da7c5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.132714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94ee2e-de94-4de8-81e9-9829d78da7c5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.140750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.141801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.142303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.142797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.157028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:34:59.164289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:34:59.166251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 410/809] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:59.172126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d38b3-351e-49fa-bc22-6a265492736b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.183000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d38b3-351e-49fa-bc22-6a265492736b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.191118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.192157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.192677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.193170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.194144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:59.194668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.196526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.210232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 400/810] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:59.211609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.224546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c239b78-403f-4cc7-8272-28f0ec6b96bc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.236382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.237618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.238078 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.238556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.258442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.260991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.285604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:59.287169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 411/811] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:59.292394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.308691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571cab3-60b2-4310-bc82-f5199eb1de3d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.318999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.320041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.320561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.321045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.322517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:59.323049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.324863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.345509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 401/812] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:34:59.351038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.367101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca22e4-fa60-4949-b0fd-e8dbb0f8a09f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.379394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.380202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.380483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.380753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] PATH_INFO: `/v3/users/swift` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.389990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.392051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.419641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 17 09:34:59.421218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 412/813] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:59.426360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.440316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea46c23-86dc-4713-8774-3243d878240f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.456074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.457056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.457638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.458123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.459273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:59.459798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.461906 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.486892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 402/814] 10.222.0.88 () {56 vars in 1156 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:59.492647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.508515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47597a0-39a6-44ea-a881-eba7559baeee admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.522766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.523586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.523866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.524136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.537463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.539344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.564462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:34:59.565844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 413/815] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:59.572230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.598758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27badacf-c04e-42d4-8b03-f4dca432cbab admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.605520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.606482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.607022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.607519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.608469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:59.608993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.611983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.631905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 403/816] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:59.638064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.651650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff79c96-973c-406d-bf43-999d0659233b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.660535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.661346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.661626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.661898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.674505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.676519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.697491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:34:59.699180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 414/817] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:34:59.704717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.719758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea09db-8e3a-49c1-b4c8-7d0a49c4bebe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.726849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6379dc-c08c-4731-871e-61e501d02275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.727536 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6379dc-c08c-4731-871e-61e501d02275 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.727816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6379dc-c08c-4731-871e-61e501d02275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.728088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6379dc-c08c-4731-871e-61e501d02275 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.728884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6379dc-c08c-4731-871e-61e501d02275 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:34:59.729187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6379dc-c08c-4731-871e-61e501d02275 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.732086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6379dc-c08c-4731-871e-61e501d02275 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.752393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 404/818] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:34:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:34:59.758189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:34:59.773132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6075f-655f-4eb3-90f3-5cb62da06388 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:34:59.783093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f706-55e3-439f-8e62-101f5eaeac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:34:59.783996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f706-55e3-439f-8e62-101f5eaeac0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.784278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f706-55e3-439f-8e62-101f5eaeac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.784553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f706-55e3-439f-8e62-101f5eaeac0c admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/9c247c8b8bfe484bb39112144317e59c/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.792174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f706-55e3-439f-8e62-101f5eaeac0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=9c247c8b8bfe484bb39112144317e59c, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:34:59.795414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f706-55e3-439f-8e62-101f5eaeac0c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:34:59.925909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 415/819] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:34:59 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/9c247c8b8bfe484bb39112144317e59c/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:34:59.943743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80469-2669-49c4-b901-b193dce5c94b None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.952373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80469-2669-49c4-b901-b193dce5c94b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.952373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80469-2669-49c4-b901-b193dce5c94b None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.952373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 405/820] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:34:59.953046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55695c5-82af-4dd0-8e70-ce5d44f067b8 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:34:59.953046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55695c5-82af-4dd0-8e70-ce5d44f067b8 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:34:59.953046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55695c5-82af-4dd0-8e70-ce5d44f067b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:34:59.980069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f55695c5-82af-4dd0-8e70-ce5d44f067b8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:34:59.981301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f55695c5-82af-4dd0-8e70-ce5d44f067b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:00.061547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 416/821] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:34:59 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:00.090103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80469-2669-49c4-b901-b193dce5c94b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.110287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80469-2669-49c4-b901-b193dce5c94b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.117421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.118830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.119163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.119437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.120114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.121747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.136202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 17 09:35:00.137458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 406/822] 10.222.0.88 () {56 vars in 1150 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:00.143608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55695c5-82af-4dd0-8e70-ce5d44f067b8 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.156417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55695c5-82af-4dd0-8e70-ce5d44f067b8 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.161484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.162165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.162452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.162738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.163493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:00.163802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.165464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.172263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 417/823] 10.222.0.88 () {56 vars in 1145 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:00.177892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.192220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb2836-690e-4d4e-a107-2a2de5c69c90 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.197780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b46bd9-83bc-4450-a97f-b75f7a954fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.198718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46bd9-83bc-4450-a97f-b75f7a954fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.199434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46bd9-83bc-4450-a97f-b75f7a954fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.199985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46bd9-83bc-4450-a97f-b75f7a954fa3 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.200953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b46bd9-83bc-4450-a97f-b75f7a954fa3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:00.201496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b46bd9-83bc-4450-a97f-b75f7a954fa3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.203583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b46bd9-83bc-4450-a97f-b75f7a954fa3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.210779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 407/824] 10.222.0.88 () {56 vars in 1145 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:00.216626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.228727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0792db-50f5-40a4-a990-95bd33e9bfac admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.234329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2db1c-27d3-43ac-b61c-57aebd6513b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.235210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2db1c-27d3-43ac-b61c-57aebd6513b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.235688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2db1c-27d3-43ac-b61c-57aebd6513b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.236192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2db1c-27d3-43ac-b61c-57aebd6513b9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.237111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2db1c-27d3-43ac-b61c-57aebd6513b9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.238338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-77d2db1c-27d3-43ac-b61c-57aebd6513b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:35:00.238338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:35:00.238338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:35:00.239660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2db1c-27d3-43ac-b61c-57aebd6513b9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.335899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 418/825] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:00.348063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c8c64-b716-446b-a240-5ae49fb87750 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.348407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c8c64-b716-446b-a240-5ae49fb87750 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.348629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c8c64-b716-446b-a240-5ae49fb87750 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.350777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 408/826] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:00.356761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09147f-b48d-4f9c-a778-377a3ce3f096 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.357101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09147f-b48d-4f9c-a778-377a3ce3f096 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.357309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09147f-b48d-4f9c-a778-377a3ce3f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.381636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-bb09147f-b48d-4f9c-a778-377a3ce3f096 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:00.382893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-bb09147f-b48d-4f9c-a778-377a3ce3f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:00.410882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 419/827] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:00 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:00.454243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c8c64-b716-446b-a240-5ae49fb87750 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.472516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c8c64-b716-446b-a240-5ae49fb87750 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.477095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.477924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.478206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.478480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] PATH_INFO: `/v3/services/network` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.479173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.480785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.498643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 17 09:35:00.500191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 409/828] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:00.506104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09147f-b48d-4f9c-a778-377a3ce3f096 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.516367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09147f-b48d-4f9c-a778-377a3ce3f096 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.532398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.533897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.533897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.533897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.534381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] RBAC: Adding query filter params (name=network) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:00.534682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.536307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.541871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 420/829] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:00.547334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.560674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bfe53-02e8-4a46-8ec5-6de71e491d9f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.567278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d61dd9-edb0-4f56-9fbd-14e965895cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.567939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d61dd9-edb0-4f56-9fbd-14e965895cdd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.568223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d61dd9-edb0-4f56-9fbd-14e965895cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.568502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d61dd9-edb0-4f56-9fbd-14e965895cdd admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.569229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d61dd9-edb0-4f56-9fbd-14e965895cdd admin admin] RBAC: Adding query filter params (type=network) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:00.569534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d61dd9-edb0-4f56-9fbd-14e965895cdd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.571268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d61dd9-edb0-4f56-9fbd-14e965895cdd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.580409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 410/830] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:00.586307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.596172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df795c4-d512-4c9f-837b-c89cace66916 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.602894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.603547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.603825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.604254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.605002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.606586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.639929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483573e6-2675-46d7-a148-7bf16c122bd2 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.640234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483573e6-2675-46d7-a148-7bf16c122bd2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.640492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483573e6-2675-46d7-a148-7bf16c122bd2 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.642709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 411/831] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:00.648088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899fb2c-6149-4d72-b2bc-7a799b95e264 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.648415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899fb2c-6149-4d72-b2bc-7a799b95e264 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.648698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899fb2c-6149-4d72-b2bc-7a799b95e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.668310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3899fb2c-6149-4d72-b2bc-7a799b95e264 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:00.671372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3899fb2c-6149-4d72-b2bc-7a799b95e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:00.678531 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 412/832] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:00 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:00.704479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899fb2c-6149-4d72-b2bc-7a799b95e264 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.704659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 421/833] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:00.719100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899fb2c-6149-4d72-b2bc-7a799b95e264 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.741945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.742862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.743713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.743998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.744784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.746475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.763163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 17 09:35:00.764569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 413/834] 10.222.0.88 () {56 vars in 1153 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:00.770793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.791872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619020be-53a8-4a78-89d8-4aeed109dff2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.799468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09914bed-8ea1-4c8b-a48c-ff7fa0ef06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.800157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914bed-8ea1-4c8b-a48c-ff7fa0ef06b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.800438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914bed-8ea1-4c8b-a48c-ff7fa0ef06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.800709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09914bed-8ea1-4c8b-a48c-ff7fa0ef06b0 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.801448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09914bed-8ea1-4c8b-a48c-ff7fa0ef06b0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:00.801752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09914bed-8ea1-4c8b-a48c-ff7fa0ef06b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.803455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09914bed-8ea1-4c8b-a48c-ff7fa0ef06b0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.815512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 422/835] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:00.820898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:00.834959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000f9f-8f6d-4d9c-89d0-ab1578e76a03 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:00.843341 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5851-a3fc-40ea-8864-ac8261744fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:00.843990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5851-a3fc-40ea-8864-ac8261744fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:00.844280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5851-a3fc-40ea-8864-ac8261744fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:00.844654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5851-a3fc-40ea-8864-ac8261744fb4 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:00.845398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5851-a3fc-40ea-8864-ac8261744fb4 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:00.845761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5851-a3fc-40ea-8864-ac8261744fb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:00.847428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5851-a3fc-40ea-8864-ac8261744fb4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:00.859171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 414/836] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:01.354479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483a6b-edab-47a9-81f0-d4c589d111f9 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.355197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483a6b-edab-47a9-81f0-d4c589d111f9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.355197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483a6b-edab-47a9-81f0-d4c589d111f9 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.357117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 423/837] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:01.363344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c078-d151-48f0-81ce-bb5a700da9c6 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.363889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c078-d151-48f0-81ce-bb5a700da9c6 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.363889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c078-d151-48f0-81ce-bb5a700da9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.383035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4bb6c078-d151-48f0-81ce-bb5a700da9c6 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:01.384802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4bb6c078-d151-48f0-81ce-bb5a700da9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:01.393643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 415/838] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:01 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:01.418836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483a6b-edab-47a9-81f0-d4c589d111f9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.431677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483a6b-edab-47a9-81f0-d4c589d111f9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.436084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.436861 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.437142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.437406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.447732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:01.454492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:35:01.456082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 424/839] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:01.461551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c078-d151-48f0-81ce-bb5a700da9c6 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.470720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c078-d151-48f0-81ce-bb5a700da9c6 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.475595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.476265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.476550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.476833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.478136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:01.478445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.480077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.489290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 416/840] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:01.495241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.505878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dbbc3-5a0c-46b9-9b90-b78ec9a631fb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.510453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.511250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.511535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.511805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.521857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.523734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.541985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:01.543512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 425/841] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:01.548974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.559587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156206ea-a4bd-4ddd-9173-5faaf3aa0ae0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.564229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.564893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.565180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.565456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.566188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:01.566494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.568135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.580998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 417/842] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:01.586417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.598490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a524fb-2028-4bfa-a9a3-1c334862664d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.604975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.605781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.606061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.606339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.621337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.625536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.642079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 17 09:35:01.643674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 426/843] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:01.649262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.660146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc766-1c6e-491b-8c7a-4b64802d4d51 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.665373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.666088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.666422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.666701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.667577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:01.667885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.669771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.689099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 418/844] 10.222.0.88 () {56 vars in 1170 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:01.694583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.705103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98e587-0800-4456-a44b-fbcf7a394042 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.710369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.711082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.711413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.711692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.721055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.722914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.733930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 427/845] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:01.739451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.750322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9343a96-f622-47fc-846b-cd660797964f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.755092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.755943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.756227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.756553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.767682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.769579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.788780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:01.794984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 419/846] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:01.796593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.805908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050345a-c5ca-4861-b862-a6584e98e540 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.810854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.811508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.811784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.812055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.812839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:01.813138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.814821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.827149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 428/847] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:01.832450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.843124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd97d-b1ae-4f42-b6db-76be600bb032 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.847731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.848514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.848845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.849116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.857180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.859142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.872267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:01.873739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 420/848] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:01.879310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.889011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96468df9-d361-4365-8baa-745c38cfb173 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.893519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e93f5-248c-444e-924c-97de10b34edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.894158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e93f5-248c-444e-924c-97de10b34edd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.894481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e93f5-248c-444e-924c-97de10b34edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.894779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e93f5-248c-444e-924c-97de10b34edd admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.895571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e93f5-248c-444e-924c-97de10b34edd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:01.895920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e93f5-248c-444e-924c-97de10b34edd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.897805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e93f5-248c-444e-924c-97de10b34edd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.911363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 429/849] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:01.917672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:01.928449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ff2f6-b871-4812-935c-cba4a8a59f5c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:01.933158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c99c7-328a-41c4-ab5d-c537d02af616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:01.933844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c99c7-328a-41c4-ab5d-c537d02af616 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:01.934109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c99c7-328a-41c4-ab5d-c537d02af616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:01.934373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c99c7-328a-41c4-ab5d-c537d02af616 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:01.935238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c99c7-328a-41c4-ab5d-c537d02af616 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=5a93d97f27354602aa778cea8d184455) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:01.935587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c99c7-328a-41c4-ab5d-c537d02af616 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:01.937455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c99c7-328a-41c4-ab5d-c537d02af616 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:01.943988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 421/850] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:01 2022] GET /identity/v3/role_assignments?user.id=5a93d97f27354602aa778cea8d184455&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:02.526145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6085a-cb70-423e-83f0-e4697d8d1e78 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.526875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6085a-cb70-423e-83f0-e4697d8d1e78 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.526875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6085a-cb70-423e-83f0-e4697d8d1e78 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.528729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 430/851] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:02.534393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585861-7ab9-4f78-9f24-5321d11cc923 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.534928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585861-7ab9-4f78-9f24-5321d11cc923 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.535209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585861-7ab9-4f78-9f24-5321d11cc923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.553506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-cc585861-7ab9-4f78-9f24-5321d11cc923 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:02.554674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cc585861-7ab9-4f78-9f24-5321d11cc923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:02.563559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 422/852] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:02 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:02.588390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6085a-cb70-423e-83f0-e4697d8d1e78 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.601160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6085a-cb70-423e-83f0-e4697d8d1e78 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.607414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.608263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.608816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.609321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.626447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:02.634965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:35:02.636473 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 431/853] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:02.642335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585861-7ab9-4f78-9f24-5321d11cc923 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.652817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585861-7ab9-4f78-9f24-5321d11cc923 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.657707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.658371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.658655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.658970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.659734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:02.660038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.661724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.671041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 423/854] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:02.676651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.687434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb9a48-a379-47ea-96b1-fd0399102787 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.692361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.693144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.693471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.693750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.706070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.708009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.724939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:02.726459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 432/855] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:02.732226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.745153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8f7e3-c01a-4e6d-9537-da925280fa01 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.750224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e056ea-0ca3-4ce1-83d3-132464359f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.751187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e056ea-0ca3-4ce1-83d3-132464359f73 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.751728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e056ea-0ca3-4ce1-83d3-132464359f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.752230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e056ea-0ca3-4ce1-83d3-132464359f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.753288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e056ea-0ca3-4ce1-83d3-132464359f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:02.753870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e056ea-0ca3-4ce1-83d3-132464359f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.755795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e056ea-0ca3-4ce1-83d3-132464359f73 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.769490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 424/856] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:02.775522 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.786454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30626f1e-69a6-494a-b8a0-f16428e5826e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.791474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.792617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.793196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.793662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.802924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.805320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.812439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7d5d2-d60e-41ff-ad16-9fbcb026bc22 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.812727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7d5d2-d60e-41ff-ad16-9fbcb026bc22 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.813009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7d5d2-d60e-41ff-ad16-9fbcb026bc22 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.815064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 425/857] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:02.820224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f324b5-b9d0-4d38-8976-899cb12d8404 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.820508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f324b5-b9d0-4d38-8976-899cb12d8404 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.820783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f324b5-b9d0-4d38-8976-899cb12d8404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.822608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 17 09:35:02.824471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 433/858] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:02.831022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.842855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-a7f324b5-b9d0-4d38-8976-899cb12d8404 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:02.843607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbb29b-cf6f-45e8-9f72-211dcce0fc62 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.844038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a7f324b5-b9d0-4d38-8976-899cb12d8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:02.848616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.849280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.849641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.849844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.850774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:02.851084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.852958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.858884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 426/859] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:02 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:02.872304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 434/860] 10.222.0.88 () {56 vars in 1156 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:02.875613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f324b5-b9d0-4d38-8976-899cb12d8404 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.880010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.885255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f324b5-b9d0-4d38-8976-899cb12d8404 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.890418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.891289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.891571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.891840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.892510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.894175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.894777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588a0df-9750-450c-93a4-f9b8e438d8ab admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.900602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.901596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.902076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.902591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.905532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 17 09:35:02.911970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 427/861] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:02.912431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.912974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.915315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.923250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343606-ffcb-4483-8cce-a76854a3ae1e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.927379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 435/862] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:02.932692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.932692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.932692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.932692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.933042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:02.933042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.933042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.935049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.942847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 428/863] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:02.944374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:02.945714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9049e-06c8-44b4-8a27-f95352c7b20c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.951851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.953057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.953632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.954081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6789f1-f95b-45b5-a959-3f1b5bc63e17 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:02.954311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.958915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:02.959573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:02.959864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:02.960133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:02.960856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:02.961176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.963088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.969099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:02.971311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:02.974962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 429/864] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:02.994515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:02.996251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 436/865] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:03.002719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:03.013745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea1b4-08b3-402b-be7e-2a4319745edd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:03.019052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:03.020101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:03.020615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:03.021140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:03.022133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:03.022684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:03.024661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:03.039713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 430/866] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:03.046634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:03.058508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d23fd-6660-41c7-8672-92a01e72383e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:03.063925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:03.065171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:03.065708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:03.066198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:03.074852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:03.077245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:03.092105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:03.094123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 437/867] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:03.100505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:03.112077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874cecc-7b69-4e99-834a-2a0bb916658c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:03.117607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d3b23-9443-4f1e-adb8-3ab8a1383ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:03.119388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3b23-9443-4f1e-adb8-3ab8a1383ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:03.120006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3b23-9443-4f1e-adb8-3ab8a1383ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:03.120530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3b23-9443-4f1e-adb8-3ab8a1383ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:03.121669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d3b23-9443-4f1e-adb8-3ab8a1383ef2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:03.122185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d3b23-9443-4f1e-adb8-3ab8a1383ef2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:03.124353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d3b23-9443-4f1e-adb8-3ab8a1383ef2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:03.139243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 431/868] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:03.145471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:03.158331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0178d-4d53-45e5-9426-799bd39e7929 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:03.163295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbe490-c1eb-4e12-b53c-82b8f8f40cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:03.164203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe490-c1eb-4e12-b53c-82b8f8f40cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:03.164707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe490-c1eb-4e12-b53c-82b8f8f40cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:03.165216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe490-c1eb-4e12-b53c-82b8f8f40cd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:03.166261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbe490-c1eb-4e12-b53c-82b8f8f40cd1 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=9c247c8b8bfe484bb39112144317e59c) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:03.166805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbe490-c1eb-4e12-b53c-82b8f8f40cd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:03.168972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbe490-c1eb-4e12-b53c-82b8f8f40cd1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:03.176090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 438/869] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:03 2022] GET /identity/v3/role_assignments?user.id=9c247c8b8bfe484bb39112144317e59c&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:03.229045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d838-df08-4f17-a06e-b2fa4d656c1d None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:03.229359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d838-df08-4f17-a06e-b2fa4d656c1d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:03.229602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d838-df08-4f17-a06e-b2fa4d656c1d None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:03.231617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 432/870] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:03.237914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f5d0-be74-41af-b54e-f02de1c76133 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:03.238367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f5d0-be74-41af-b54e-f02de1c76133 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:03.238708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f5d0-be74-41af-b54e-f02de1c76133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:03.262206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8288f5d0-be74-41af-b54e-f02de1c76133 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:03.263453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8288f5d0-be74-41af-b54e-f02de1c76133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:03.278863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 439/871] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:03 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:03.296716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d838-df08-4f17-a06e-b2fa4d656c1d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:03.309925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d838-df08-4f17-a06e-b2fa4d656c1d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:03.314789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325309f0-b585-4070-8ea4-e71b46882d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:03.315466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325309f0-b585-4070-8ea4-e71b46882d25 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:03.315790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325309f0-b585-4070-8ea4-e71b46882d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:03.316180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325309f0-b585-4070-8ea4-e71b46882d25 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:03.317005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325309f0-b585-4070-8ea4-e71b46882d25 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:03.318690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325309f0-b585-4070-8ea4-e71b46882d25 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:03.406239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 433/872] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:35:03 2022] POST /identity/v3/services => generated 269 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:04.304046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece8ec-425c-4745-a493-4e820789c687 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.304994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece8ec-425c-4745-a493-4e820789c687 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.305473 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ece8ec-425c-4745-a493-4e820789c687 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.307782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 440/873] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:04.314414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60e12-dfa8-48ec-b6c9-61f4d3263f42 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.315344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60e12-dfa8-48ec-b6c9-61f4d3263f42 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.315792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60e12-dfa8-48ec-b6c9-61f4d3263f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.334238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5cd60e12-dfa8-48ec-b6c9-61f4d3263f42 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:04.335746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5cd60e12-dfa8-48ec-b6c9-61f4d3263f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:04.353986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 434/874] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:04 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:04.380733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece8ec-425c-4745-a493-4e820789c687 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.393876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ece8ec-425c-4745-a493-4e820789c687 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.398506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.400086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.400562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.401008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.412997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:04.421254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 17 09:35:04.423172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 441/875] 10.222.0.88 () {56 vars in 1141 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:04.429309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60e12-dfa8-48ec-b6c9-61f4d3263f42 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.440777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60e12-dfa8-48ec-b6c9-61f4d3263f42 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.445727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.447146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.447624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.448082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.449062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:04.449546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.451322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.460107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 435/876] 10.222.0.88 () {56 vars in 1136 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:04.466938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.477684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125cd5-135d-4009-a275-14be9d3b3d71 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.482436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.483456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.483977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.484562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.495943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.498008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.515464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:04.517229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 442/877] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:04.522851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.533545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79f19-306d-4d10-a92d-806f01bbecd7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.538280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.539158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.539641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.540114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.541057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:04.541533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.543306 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.558336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 436/878] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:04.563844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.574385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e20f1-07ec-4c87-a34c-30c2170043a0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.578999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.579854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.580133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.580405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.589910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.591998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.605800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 17 09:35:04.607296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 443/879] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:04.614270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.630589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051abc7f-319f-4806-8b08-d8e6077aff13 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.641129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.641871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.642137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.642408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.643382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:04.643686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.645738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.675379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 437/880] 10.222.0.88 () {56 vars in 1170 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:04.692762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.698304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574dd8d-0429-4a0c-989f-c35dc571379f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.707843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.709537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.710482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.711083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.726960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.731922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.744195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 444/881] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:04.750861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.760273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63610-913b-4e5a-9f13-03c97757c82a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.764832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.765619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.765900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.766176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.777204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.779037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.796543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:04.798070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 438/882] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:04.803511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.812712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b54c4-199e-4caf-8d2e-353a73127a6a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.817935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.818594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.818919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.819196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.819931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:04.820237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.821863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.834064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 445/883] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:04.840030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.850718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea86f81-cee5-451a-bade-6fe1cf7cc70e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.855984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.856771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.857173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.857504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.864815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.866791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.879831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:04.881333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 439/884] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:04.886979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.896832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063b608-262e-4de5-8f0b-c4478ed5a227 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.902045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea31e-fa48-4473-a6d6-300344faa2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.902710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea31e-fa48-4473-a6d6-300344faa2ef admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.903084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea31e-fa48-4473-a6d6-300344faa2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.903368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea31e-fa48-4473-a6d6-300344faa2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.904156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ea31e-fa48-4473-a6d6-300344faa2ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:04.904463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ea31e-fa48-4473-a6d6-300344faa2ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.906299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ea31e-fa48-4473-a6d6-300344faa2ef admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.919727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 446/885] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:04.925628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:04.936223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907dfa8-440a-44be-9bb9-fe180132bb2b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:04.940854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae055e-7006-44bb-a777-f109ae864f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:04.941500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae055e-7006-44bb-a777-f109ae864f2c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:04.941782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae055e-7006-44bb-a777-f109ae864f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:04.942059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae055e-7006-44bb-a777-f109ae864f2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:04.942922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae055e-7006-44bb-a777-f109ae864f2c admin admin] RBAC: Adding query filter params (role.id=a6cf142bcc2a4550b1b2b07a8cce43b6, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=5a93d97f27354602aa778cea8d184455) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:04.943233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae055e-7006-44bb-a777-f109ae864f2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:04.945080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae055e-7006-44bb-a777-f109ae864f2c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:04.951239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 440/886] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:04 2022] GET /identity/v3/role_assignments?user.id=5a93d97f27354602aa778cea8d184455&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=a6cf142bcc2a4550b1b2b07a8cce43b6 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:05.378174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debbee4-9c57-4751-a92d-805ba79d82f9 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.378862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debbee4-9c57-4751-a92d-805ba79d82f9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.378862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debbee4-9c57-4751-a92d-805ba79d82f9 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.380818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 447/887] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:05.387432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dd928-b064-4fe5-89de-b1695074c947 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.389623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dd928-b064-4fe5-89de-b1695074c947 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.389623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dd928-b064-4fe5-89de-b1695074c947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.407624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d42dd928-b064-4fe5-89de-b1695074c947 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:05.408813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d42dd928-b064-4fe5-89de-b1695074c947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:05.416872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 441/888] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:05 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:05.439762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debbee4-9c57-4751-a92d-805ba79d82f9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.453866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debbee4-9c57-4751-a92d-805ba79d82f9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.459587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e27c-b6ed-4187-a96b-5bbfe53c8e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.460749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e27c-b6ed-4187-a96b-5bbfe53c8e3f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.461258 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e27c-b6ed-4187-a96b-5bbfe53c8e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.462390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e27c-b6ed-4187-a96b-5bbfe53c8e3f admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.463407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e27c-b6ed-4187-a96b-5bbfe53c8e3f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.465275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e27c-b6ed-4187-a96b-5bbfe53c8e3f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.549959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 448/889] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:35:05 2022] POST /identity/v3/services => generated 251 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:05.615676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae841ac-0b48-46cb-9425-b28e04d00046 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.616025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae841ac-0b48-46cb-9425-b28e04d00046 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.616232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae841ac-0b48-46cb-9425-b28e04d00046 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.619140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 442/890] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:05.625167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a14d3-8172-4c42-8ec8-a5a0799c431e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.625579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a14d3-8172-4c42-8ec8-a5a0799c431e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.625881 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a14d3-8172-4c42-8ec8-a5a0799c431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.646887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a89a14d3-8172-4c42-8ec8-a5a0799c431e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:05.648093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a89a14d3-8172-4c42-8ec8-a5a0799c431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:05.672576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 449/891] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:05 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:05.696103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd69f-387e-445b-9c2b-980658d919f0 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.696950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd69f-387e-445b-9c2b-980658d919f0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.697283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd69f-387e-445b-9c2b-980658d919f0 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.699431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a14d3-8172-4c42-8ec8-a5a0799c431e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.699647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 443/892] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:05.708486 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e974e02-61c6-4205-9caf-e9b8cd72eaaf None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.708826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e974e02-61c6-4205-9caf-e9b8cd72eaaf None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.709037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e974e02-61c6-4205-9caf-e9b8cd72eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.711497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a14d3-8172-4c42-8ec8-a5a0799c431e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.717996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.719226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.719739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.720274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.721182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.723754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.728337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5e974e02-61c6-4205-9caf-e9b8cd72eaaf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:05.729560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5e974e02-61c6-4205-9caf-e9b8cd72eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:05.737644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 17 09:35:05.737928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 444/893] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:05 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:05.739592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 450/894] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:05.746766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e974e02-61c6-4205-9caf-e9b8cd72eaaf None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.756277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e974e02-61c6-4205-9caf-e9b8cd72eaaf None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.763353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.764156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.764551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.764914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.765735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:05.766135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.767544 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.768847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.776288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 445/895] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:05.781832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4fcd0-294e-4100-b6a1-70a5c51f66c9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.783085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.788786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.790285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.790559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.790861 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.791835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.793442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.793870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658adbd4-ae84-46c5-985c-2e06ac809565 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.800400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.801179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.801555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.802035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.803490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:05.803490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.804914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.809114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 17 09:35:05.809950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 451/896] 10.222.0.88 () {56 vars in 1153 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:05.814780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 446/897] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:05.816438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.828607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0bed4-e27e-4cdb-817c-02894324cd6e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.840544 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.841419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.841774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.842123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.843029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:05.843415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.845203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.854871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 452/898] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:05.860404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.873039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3ec5f-5ae7-4101-949a-5467f9317aed admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.877843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.878572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.878886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.879209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.879942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:05.880293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.882085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.888905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 447/899] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:05.894713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.907547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aff23d-0169-4b77-ab71-ab2c2aa58481 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.912753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56303b-2e85-4463-86d2-2abd0a116240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.913686 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56303b-2e85-4463-86d2-2abd0a116240 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.914140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56303b-2e85-4463-86d2-2abd0a116240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.914570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56303b-2e85-4463-86d2-2abd0a116240 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.916121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56303b-2e85-4463-86d2-2abd0a116240 admin admin] RBAC: Adding query filter params (interface=public, service_id=ac47711ff3604802adf35b029ea35062, region_id=RegionOne) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:05.916582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56303b-2e85-4463-86d2-2abd0a116240 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.918435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56303b-2e85-4463-86d2-2abd0a116240 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.925294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 453/900] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/endpoints?service_id=ac47711ff3604802adf35b029ea35062&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:05.931855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:05.942485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad03582-3a97-40af-98ea-51d9907e8094 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:05.950685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354c37b-1148-4257-a42d-939fdb4ac960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:05.951674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354c37b-1148-4257-a42d-939fdb4ac960 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:05.952120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354c37b-1148-4257-a42d-939fdb4ac960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:05.952533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354c37b-1148-4257-a42d-939fdb4ac960 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:05.953420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354c37b-1148-4257-a42d-939fdb4ac960 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:05.955281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354c37b-1148-4257-a42d-939fdb4ac960 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:05.962686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 448/901] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:35:05 2022] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:35:07.225948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5502c82-c972-441e-bedd-5c16b37da47c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.226458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5502c82-c972-441e-bedd-5c16b37da47c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.226534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5502c82-c972-441e-bedd-5c16b37da47c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.228604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 454/902] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:07.233997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97f06-1c10-4f6f-87fb-4ad2fb9e197d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.234494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97f06-1c10-4f6f-87fb-4ad2fb9e197d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.234572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97f06-1c10-4f6f-87fb-4ad2fb9e197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.253925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-01b97f06-1c10-4f6f-87fb-4ad2fb9e197d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:07.255170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-01b97f06-1c10-4f6f-87fb-4ad2fb9e197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:07.263968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 449/903] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:07 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:07.286773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5502c82-c972-441e-bedd-5c16b37da47c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.303565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5502c82-c972-441e-bedd-5c16b37da47c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.309213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.310289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.310792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.311320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.322886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:07.330391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 17 09:35:07.332188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 455/904] 10.222.0.88 () {56 vars in 1141 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:07.338576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97f06-1c10-4f6f-87fb-4ad2fb9e197d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.348309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97f06-1c10-4f6f-87fb-4ad2fb9e197d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.353239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.354142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.354642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.355136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.356110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:07.356610 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.358396 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.367735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 450/905] 10.222.0.88 () {56 vars in 1136 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:07.373991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.384260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8008d1-6887-475f-a0be-338fbefe5e54 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.388768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.389549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.389830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.390095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.401273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.403159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.420380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:07.421878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 456/906] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:07.427471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.438016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f15b3-f09f-497b-91e4-e05db4dfdaa8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.442586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.443278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.443558 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.443831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.444563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:07.444866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.446500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.459737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 451/907] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:07.465180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.475477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec480-d6f4-4e04-bc32-c321c98c3aa7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.480722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.481496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.481777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.482061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.491609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.494215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.512240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 17 09:35:07.513831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 457/908] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:07.519560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.529989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21ec7a-7590-4740-9d19-06967b920f9c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.534816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.535484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.535766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.536048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.536895 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:07.537201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.539145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.558620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 452/909] 10.222.0.88 () {56 vars in 1170 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:07.564028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.574057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550e20-cc10-40bf-b95b-77a68ca5652a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.578592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.579479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.579803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.580082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.591623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.593517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.610895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:07.612425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 458/910] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:07.618508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.628657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83638d0a-fecb-44b4-b6d2-6ce4ebd854a7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.633270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.634041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.634327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.634600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.635451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:07.635757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.637414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.654179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 453/911] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:07.659946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.670542 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a93c2d-3481-438e-95c3-6447bf9c0476 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.675239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.676034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.676342 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.676612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.688506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.690490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.705458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:07.707026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 459/912] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:07.716517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.726887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf4ccb-fece-4fcb-87b6-c01e74fcc4b2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.732268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a402-1b6d-4e8b-9247-17d7ca270d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.732970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a402-1b6d-4e8b-9247-17d7ca270d0f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.733250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a402-1b6d-4e8b-9247-17d7ca270d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.733576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a402-1b6d-4e8b-9247-17d7ca270d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.734425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a402-1b6d-4e8b-9247-17d7ca270d0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:07.734759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a402-1b6d-4e8b-9247-17d7ca270d0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.736674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a402-1b6d-4e8b-9247-17d7ca270d0f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.751240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 454/913] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:07.757075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:07.767319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d6d63-8a73-473d-bce3-d0b4eb7a9dd9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:07.772110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bddbbf-7f81-42f5-af24-bdeb41af4c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:07.773051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bddbbf-7f81-42f5-af24-bdeb41af4c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:07.773330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bddbbf-7f81-42f5-af24-bdeb41af4c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:07.773601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bddbbf-7f81-42f5-af24-bdeb41af4c36 admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/5a93d97f27354602aa778cea8d184455/roles/a6cf142bcc2a4550b1b2b07a8cce43b6` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:07.776557 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bddbbf-7f81-42f5-af24-bdeb41af4c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=5a93d97f27354602aa778cea8d184455, role_id=a6cf142bcc2a4550b1b2b07a8cce43b6)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:07.779357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bddbbf-7f81-42f5-af24-bdeb41af4c36 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:07.863872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 460/914] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:35:07 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/5a93d97f27354602aa778cea8d184455/roles/a6cf142bcc2a4550b1b2b07a8cce43b6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:35:08.070096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ffdcd-7ff0-4e38-b903-80d44a1d479f None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.070450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ffdcd-7ff0-4e38-b903-80d44a1d479f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.070897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ffdcd-7ff0-4e38-b903-80d44a1d479f None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.073755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 455/915] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:08.079503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6085c5-e92d-47a3-b09d-511e70d12117 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.079857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6085c5-e92d-47a3-b09d-511e70d12117 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.080274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6085c5-e92d-47a3-b09d-511e70d12117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.110948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9d6085c5-e92d-47a3-b09d-511e70d12117 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:08.112267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9d6085c5-e92d-47a3-b09d-511e70d12117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:08.176845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 461/916] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:08 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:08.188043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52631568-82a8-4fab-b024-aa7edf84f1ee None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.188341 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52631568-82a8-4fab-b024-aa7edf84f1ee None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.188587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52631568-82a8-4fab-b024-aa7edf84f1ee None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.190718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 456/917] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:08.196971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56b182-eac1-4272-8b76-ce275e180cc4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.197248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56b182-eac1-4272-8b76-ce275e180cc4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.197513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56b182-eac1-4272-8b76-ce275e180cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.208146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52631568-82a8-4fab-b024-aa7edf84f1ee None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.217726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2b56b182-eac1-4272-8b76-ce275e180cc4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:08.219315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2b56b182-eac1-4272-8b76-ce275e180cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:08.221130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52631568-82a8-4fab-b024-aa7edf84f1ee None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.225704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.226550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.226866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.227167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.227834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.228980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 462/918] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:08 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:08.229418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.241501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 17 09:35:08.243915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 457/919] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:08.250775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56b182-eac1-4272-8b76-ce275e180cc4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.259116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.260110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56b182-eac1-4272-8b76-ce275e180cc4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.264981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.265645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.265925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.266772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.266947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:08.267252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.268873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.271469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b110-0b91-48f3-acb2-856444e005d7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.274870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 463/920] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:08.277803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44ad8-20de-4a5f-bf6e-9dc949a6f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.278675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44ad8-20de-4a5f-bf6e-9dc949a6f683 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.279177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44ad8-20de-4a5f-bf6e-9dc949a6f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.279613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44ad8-20de-4a5f-bf6e-9dc949a6f683 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.280287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.280705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44ad8-20de-4a5f-bf6e-9dc949a6f683 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.282855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44ad8-20de-4a5f-bf6e-9dc949a6f683 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.290619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae7b15-148c-4e7b-821b-1591bdc2d93a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.296899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.297355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.297636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.297907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.298627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:08.298959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.300545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.306173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 464/921] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:08.312000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.322907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbead0-abfe-4f28-b075-37f70ae7c9b2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.327706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.328370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.328636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.328908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.329703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] RBAC: Adding query filter params (interface=public, service_id=b6881249dc8146d3bd00581862104626, region_id=RegionOne) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:08.330013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.331722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.341856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 465/922] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/endpoints?service_id=b6881249dc8146d3bd00581862104626&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:08.344531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.356343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499444-5140-47c4-968f-ae2e0dfce5f4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.361214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db87c0-1006-40e7-a7a9-f2b5fa7acdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.361875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db87c0-1006-40e7-a7a9-f2b5fa7acdaa admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.362158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db87c0-1006-40e7-a7a9-f2b5fa7acdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.362434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db87c0-1006-40e7-a7a9-f2b5fa7acdaa admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.363160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db87c0-1006-40e7-a7a9-f2b5fa7acdaa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.367126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db87c0-1006-40e7-a7a9-f2b5fa7acdaa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.373460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 466/923] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:35:08.390298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 458/924] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:35:08 2022] POST /identity/v3/services => generated 241 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:35:08.449239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a8c6-c522-488f-9c8b-470ae6305870 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.449633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a8c6-c522-488f-9c8b-470ae6305870 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.449916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44a8c6-c522-488f-9c8b-470ae6305870 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.452134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 467/925] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:08.458202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c9ac1-ffd7-494c-9841-0221bf3fe0c8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.458513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c9ac1-ffd7-494c-9841-0221bf3fe0c8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.458776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c9ac1-ffd7-494c-9841-0221bf3fe0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.479696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f30c9ac1-ffd7-494c-9841-0221bf3fe0c8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:08.481056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f30c9ac1-ffd7-494c-9841-0221bf3fe0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:08.499912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 459/926] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:08 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:08.526112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a8c6-c522-488f-9c8b-470ae6305870 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.539680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44a8c6-c522-488f-9c8b-470ae6305870 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.545157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.546479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.547025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.547516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.548455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.550349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.563741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 17 09:35:08.571482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 468/927] 10.222.0.88 () {56 vars in 1153 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:08.573659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c9ac1-ffd7-494c-9841-0221bf3fe0c8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.583938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c9ac1-ffd7-494c-9841-0221bf3fe0c8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.589589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.590267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.590720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.591094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.591949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:08.592373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.593924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.599481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 460/928] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:08.605465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.616011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6284e-d648-41eb-8b00-c618c6856f42 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.621838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957b691-b608-45f6-9eb9-1e9d6b8510bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.622885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b691-b608-45f6-9eb9-1e9d6b8510bf admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.623369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b691-b608-45f6-9eb9-1e9d6b8510bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.623893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b691-b608-45f6-9eb9-1e9d6b8510bf admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.624863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957b691-b608-45f6-9eb9-1e9d6b8510bf admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:08.625347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957b691-b608-45f6-9eb9-1e9d6b8510bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.627160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957b691-b608-45f6-9eb9-1e9d6b8510bf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.632683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 469/929] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:08.642268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:08.653836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42bc7-158e-4669-99a2-312907400724 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:08.658672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fc075-2bb7-4893-a833-b619c53b712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:08.659489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc075-2bb7-4893-a833-b619c53b712c admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:08.659770 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc075-2bb7-4893-a833-b619c53b712c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:08.660036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc075-2bb7-4893-a833-b619c53b712c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:08.661215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fc075-2bb7-4893-a833-b619c53b712c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:08.666995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-f51fc075-2bb7-4893-a833-b619c53b712c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:35:08.666995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:35:08.666995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:35:08.666995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fc075-2bb7-4893-a833-b619c53b712c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:08.761331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 461/930] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:10.359438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c738-4b91-42e9-91e6-91427ef16cec None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.360541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c738-4b91-42e9-91e6-91427ef16cec None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.361117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c738-4b91-42e9-91e6-91427ef16cec None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.363676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 470/931] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:10.375495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d72128-c4ec-4eec-9514-88f14de0036e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.376378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d72128-c4ec-4eec-9514-88f14de0036e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.376852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d72128-c4ec-4eec-9514-88f14de0036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.398617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-29d72128-c4ec-4eec-9514-88f14de0036e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:10.400944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-29d72128-c4ec-4eec-9514-88f14de0036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:10.421619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 462/932] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:10 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:10.447275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c738-4b91-42e9-91e6-91427ef16cec None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.460355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c738-4b91-42e9-91e6-91427ef16cec None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.465606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.466420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.466702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.466999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.479040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:10.486448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 17 09:35:10.492679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 471/933] 10.222.0.88 () {56 vars in 1141 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:10.494066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d72128-c4ec-4eec-9514-88f14de0036e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.503762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d72128-c4ec-4eec-9514-88f14de0036e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.508899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.509566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.509860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.510120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.510922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:10.511228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.512910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.522250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 463/934] 10.222.0.88 () {56 vars in 1136 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:10.528464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.539116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0910-2806-4162-b26c-fb38f4751bcb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.543833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.544673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.548089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.548089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.556808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.558875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.577004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:10.582840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 472/935] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:10.584517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.597026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152397dd-b394-4eb5-aa97-b7d0669e4562 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.603098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.604142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.604647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.605108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.606084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:10.606655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.608575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.626924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 464/936] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:10.629810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.642787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478c87-87a4-463a-98e8-27ba37acfcef admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.650438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.652154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.652890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.653648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.668252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.671718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.689535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 17 09:35:10.695929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 473/937] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:10.697688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.709803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736a954-6ea1-449f-950d-620eb585a2ea admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.715078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.716302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.717011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.717779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.719393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:10.720066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.723636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.758768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 465/938] 10.222.0.88 () {56 vars in 1170 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:10.763957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.781769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931f733-7ddc-40b8-aaf7-236ddd87eefa admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.788579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f050a80-bfa5-49d6-95e5-53efcbe2ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.790636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050a80-bfa5-49d6-95e5-53efcbe2ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.791425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050a80-bfa5-49d6-95e5-53efcbe2ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.792152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f050a80-bfa5-49d6-95e5-53efcbe2ffa9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.805268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f050a80-bfa5-49d6-95e5-53efcbe2ffa9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.807480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f050a80-bfa5-49d6-95e5-53efcbe2ffa9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.822333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 474/939] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:10.824110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.835671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413da6-b56e-4c68-8650-60203e43213d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.841202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.842369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.842885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.843381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.853196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa3e6-5cb5-4e36-ab72-19d223421fd3 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.853798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa3e6-5cb5-4e36-ab72-19d223421fd3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.854274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa3e6-5cb5-4e36-ab72-19d223421fd3 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.856120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.856920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 475/940] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:10.857966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.863856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87859e-113d-4565-8b8e-f6096aa89e3c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.864425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87859e-113d-4565-8b8e-f6096aa89e3c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.864903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87859e-113d-4565-8b8e-f6096aa89e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.880091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:10.881554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 466/941] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:10.888644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ea87859e-113d-4565-8b8e-f6096aa89e3c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:10.888940 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.889922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ea87859e-113d-4565-8b8e-f6096aa89e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:10.898362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 476/942] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:10 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:10.902862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac444d-e327-4ce7-9481-8bef2e03a273 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.902984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f6c3-9279-4e5e-a401-177e066caed4 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.902984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f6c3-9279-4e5e-a401-177e066caed4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.902984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f6c3-9279-4e5e-a401-177e066caed4 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.902984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 477/943] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:10.904886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.905548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.905828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.906104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.907272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:10.907582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.908439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f294-526c-4347-a0b2-a082c8c2663d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.908736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f294-526c-4347-a0b2-a082c8c2663d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.909012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f294-526c-4347-a0b2-a082c8c2663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.909334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.922846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 467/944] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:10.928403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.932770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8b86f294-526c-4347-a0b2-a082c8c2663d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:10.933961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8b86f294-526c-4347-a0b2-a082c8c2663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:10.938452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94b418-7e69-4fcb-b3c2-a249873345bc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.941855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 478/945] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:10 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:10.942490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86f294-526c-4347-a0b2-a082c8c2663d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.949573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.951026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.951510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.951999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.952483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86f294-526c-4347-a0b2-a082c8c2663d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.957281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.958204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.958557 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.958926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.959694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.961989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.963242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:10.966293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:10.974476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 17 09:35:10.975957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 479/946] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:10.976568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.984953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:10.991181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 468/947] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:10.991181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:10.991427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a964d2e-95b0-41ee-8c95-4a644b69e6cc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.996447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:10.997249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:10.997526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:10.997797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:10.998042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8db757-979b-453f-8329-b516627a6e67 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:10.998467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.000125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.002679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.003392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.003674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.003950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.004784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.005090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.006981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.014875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 469/948] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.014875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.017357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 17 09:35:11.018591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 480/949] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:11.019529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.027046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ed351-1f93-4df5-b245-b4062d49081a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.032497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.033157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.033440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.033716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.033810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22f54-960e-439b-b274-bfb6c827ba57 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.034662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.034979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.036835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.039273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.039997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.040331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.040603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.041319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.041676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.043328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.053823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 470/950] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.053999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 481/951] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.054123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.058913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.064627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570fba7-280a-45f2-a54b-fd08b6d21f58 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.071853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.073041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.073405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d0886-054b-41eb-af7a-37ee6baf2c39 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.073660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.073965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.075298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.075750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.077355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.078099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.078768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.079049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.079344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.080166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] RBAC: Adding query filter params (role.id=a6cf142bcc2a4550b1b2b07a8cce43b6, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=5a93d97f27354602aa778cea8d184455) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.080473 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.082305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.087724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 471/952] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.087724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.098933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eb8aa-b134-4ee9-8da7-b04e150d2fd5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.099151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 482/953] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/role_assignments?user.id=5a93d97f27354602aa778cea8d184455&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=a6cf142bcc2a4550b1b2b07a8cce43b6 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.099151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.102720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.103426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.103712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.104202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.104810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] RBAC: Adding query filter params (interface=public, service_id=43283d80a5da49f2bfb42cdc75d1f374, region_id=RegionOne) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.105121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.106921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.109892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de08eaa-b6ad-4e1c-b853-de9a8e36189a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.112742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 472/954] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/endpoints?service_id=43283d80a5da49f2bfb42cdc75d1f374&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.116565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.118285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.118709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.118933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.119217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.120263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.120666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.122494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.128618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 483/955] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.129780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff971c3-6c81-4c13-83d1-a549bc0be2c8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.134684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.136710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da780-f60e-43b1-bb80-2fc6387818e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.137390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da780-f60e-43b1-bb80-2fc6387818e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.137676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da780-f60e-43b1-bb80-2fc6387818e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.137941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da780-f60e-43b1-bb80-2fc6387818e4 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.138644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0da780-f60e-43b1-bb80-2fc6387818e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.140299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0da780-f60e-43b1-bb80-2fc6387818e4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.149487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 473/956] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:35:11.162900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af64885-c494-4a38-b951-5f3b0e4db63c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.171463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.172578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.173083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.173540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.174583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.176537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.220043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69d67-76f5-4a3d-88c9-8b88433e6c77 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.220348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69d67-76f5-4a3d-88c9-8b88433e6c77 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.220596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69d67-76f5-4a3d-88c9-8b88433e6c77 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.222668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 474/957] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:11.229400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb4338-c8e6-4816-92f1-05b345b546ff None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.229688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb4338-c8e6-4816-92f1-05b345b546ff None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.229955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb4338-c8e6-4816-92f1-05b345b546ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.253911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-81bb4338-c8e6-4816-92f1-05b345b546ff None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:11.255342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-81bb4338-c8e6-4816-92f1-05b345b546ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:11.270608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 475/958] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:11 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:11.283118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 484/959] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:35:11.290074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb4338-c8e6-4816-92f1-05b345b546ff None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.300498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb4338-c8e6-4816-92f1-05b345b546ff None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.318459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.319394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.319691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.319972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.320710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.322427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.335476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 17 09:35:11.336138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 476/960] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:11.343546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.356084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e613626-f325-4726-9b48-773902f5d4a9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.363428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ae06-40e5-42aa-9765-922bf4f7a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.364123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ae06-40e5-42aa-9765-922bf4f7a088 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.364402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ae06-40e5-42aa-9765-922bf4f7a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.364673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ae06-40e5-42aa-9765-922bf4f7a088 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.365410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1ae06-40e5-42aa-9765-922bf4f7a088 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.365718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1ae06-40e5-42aa-9765-922bf4f7a088 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.367526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1ae06-40e5-42aa-9765-922bf4f7a088 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.373847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 485/961] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:11.379926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:11.391528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a9b5-04f9-4025-bd8d-8cda03ce35c7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:11.396595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd325f8d-9b4c-4219-80cd-d33b18de77c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:11.397280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325f8d-9b4c-4219-80cd-d33b18de77c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:11.397539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325f8d-9b4c-4219-80cd-d33b18de77c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:11.398027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd325f8d-9b4c-4219-80cd-d33b18de77c0 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:11.398540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd325f8d-9b4c-4219-80cd-d33b18de77c0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:11.399021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd325f8d-9b4c-4219-80cd-d33b18de77c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:11.400620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd325f8d-9b4c-4219-80cd-d33b18de77c0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:11.406078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 477/962] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:13.476719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de503b-fdae-4d9d-9489-1af5e02a69c0 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.477771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de503b-fdae-4d9d-9489-1af5e02a69c0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.478272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de503b-fdae-4d9d-9489-1af5e02a69c0 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.480507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 486/963] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:13.486380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392727a4-4f87-4b4d-9551-8e8ba8d1cb78 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.487247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392727a4-4f87-4b4d-9551-8e8ba8d1cb78 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.487725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392727a4-4f87-4b4d-9551-8e8ba8d1cb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.506469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-392727a4-4f87-4b4d-9551-8e8ba8d1cb78 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:13.508028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-392727a4-4f87-4b4d-9551-8e8ba8d1cb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:13.516753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 478/964] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:13 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:13.542345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de503b-fdae-4d9d-9489-1af5e02a69c0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.553268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e5a4-b4b2-478c-8355-7ea94e1d4e62 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.553592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e5a4-b4b2-478c-8355-7ea94e1d4e62 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.553831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1e5a4-b4b2-478c-8355-7ea94e1d4e62 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.555667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 479/965] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:13.556610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de503b-fdae-4d9d-9489-1af5e02a69c0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.561141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c10a8c-ae96-4db0-8ea2-4f5ea7160d45 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.561441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c10a8c-ae96-4db0-8ea2-4f5ea7160d45 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.561714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c10a8c-ae96-4db0-8ea2-4f5ea7160d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.562346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8df9-a20e-429e-bc7a-c3a6d85de60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.563493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8df9-a20e-429e-bc7a-c3a6d85de60a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.564063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8df9-a20e-429e-bc7a-c3a6d85de60a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.564545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8df9-a20e-429e-bc7a-c3a6d85de60a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.565502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8df9-a20e-429e-bc7a-c3a6d85de60a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.567432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8df9-a20e-429e-bc7a-c3a6d85de60a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.579821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-811d8df9-a20e-429e-bc7a-c3a6d85de60a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 17 09:35:13.581196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-72c10a8c-ae96-4db0-8ea2-4f5ea7160d45 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:13.581741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 487/966] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:13.582379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-72c10a8c-ae96-4db0-8ea2-4f5ea7160d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:13.583595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2f5e8-713e-4eaf-9006-6a3d0d19e621 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.584080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2f5e8-713e-4eaf-9006-6a3d0d19e621 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.584672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2f5e8-713e-4eaf-9006-6a3d0d19e621 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.587757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 488/967] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:13.588670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2f5e8-713e-4eaf-9006-6a3d0d19e621 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.592758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 480/968] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:13 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:13.593891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569852-b008-4908-b802-a47da6530486 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.594174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569852-b008-4908-b802-a47da6530486 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.594445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569852-b008-4908-b802-a47da6530486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.604394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2f5e8-713e-4eaf-9006-6a3d0d19e621 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.609170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.613041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.613041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.613041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.613041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:13.613041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.613399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-46569852-b008-4908-b802-a47da6530486 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:13.613869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-46569852-b008-4908-b802-a47da6530486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:13.614128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.620102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 489/969] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:13.621158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.622387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 481/970] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:13 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:13.626833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46569852-b008-4908-b802-a47da6530486 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.631880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7d6e-e220-4392-989f-37603be71b0d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.636562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46569852-b008-4908-b802-a47da6530486 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.637619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a03b44-4546-4f68-b19c-78533e665ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.638700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a03b44-4546-4f68-b19c-78533e665ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.639233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a03b44-4546-4f68-b19c-78533e665ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.639964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a03b44-4546-4f68-b19c-78533e665ba4 admin admin] PATH_INFO: `/v3/services/image` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.640824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a03b44-4546-4f68-b19c-78533e665ba4 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.641441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d33f3-5cb6-4f6c-97d1-c0d3a9542c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.642415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d33f3-5cb6-4f6c-97d1-c0d3a9542c74 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.642693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d33f3-5cb6-4f6c-97d1-c0d3a9542c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.642997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d33f3-5cb6-4f6c-97d1-c0d3a9542c74 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.643097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a03b44-4546-4f68-b19c-78533e665ba4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.643718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d33f3-5cb6-4f6c-97d1-c0d3a9542c74 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:13.644018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d33f3-5cb6-4f6c-97d1-c0d3a9542c74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.645588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d33f3-5cb6-4f6c-97d1-c0d3a9542c74 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.651718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 482/971] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:13.652949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7f4d-87e4-45a9-8760-edcc1ba25692 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.653231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7f4d-87e4-45a9-8760-edcc1ba25692 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.653494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7f4d-87e4-45a9-8760-edcc1ba25692 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.654973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c1a03b44-4546-4f68-b19c-78533e665ba4 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 17 09:35:13.655232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 483/972] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:13.655899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c7f4d-87e4-45a9-8760-edcc1ba25692 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.656160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 490/973] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:13.662964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d878d3-3391-465e-9728-29614c86c998 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.663246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d878d3-3391-465e-9728-29614c86c998 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.663518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d878d3-3391-465e-9728-29614c86c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.668277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c7f4d-87e4-45a9-8760-edcc1ba25692 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.672647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.673270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.673545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.673814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.674509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.676361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.677789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.common [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 17 09:35:13.681261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a9d878d3-3391-465e-9728-29614c86c998 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:13.682445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a9d878d3-3391-465e-9728-29614c86c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:13.690309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 491/974] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:13 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:13.691659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d878d3-3391-465e-9728-29614c86c998 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.700821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d878d3-3391-465e-9728-29614c86c998 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.705326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.705950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.706289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.706568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.707313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] RBAC: Adding query filter params (name=image) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:13.707617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.709203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.714610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 492/975] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:13.715378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.724577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47118-85c1-45d3-98eb-b66e383fcaac admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.733081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.733081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.733081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.733081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.733493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.733493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.816229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.sql.core [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 17 09:35:13.816229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 17 09:35:13.816229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [parameters: {'id': '576a6dc790774120847acb502c3c2288', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 17 09:35:13.816229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 17 09:35:13.823278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 576a6dc790774120847acb502c3c2288.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 576a6dc790774120847acb502c3c2288. Jan 17 09:35:13.824592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 484/976] 10.222.0.88 () {60 vars in 1161 bytes} [Mon Jan 17 09:35:13 2022] POST /identity/v3/projects => generated 262 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:13.828800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.836119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473281c-43b5-4ff8-872d-1111c62152ec admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.840584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0537c-860e-4f51-8768-48de9b0fdb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.841187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0537c-860e-4f51-8768-48de9b0fdb66 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.841468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0537c-860e-4f51-8768-48de9b0fdb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.841741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0537c-860e-4f51-8768-48de9b0fdb66 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.842454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0537c-860e-4f51-8768-48de9b0fdb66 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.844325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0537c-860e-4f51-8768-48de9b0fdb66 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.885936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 493/977] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:13.886465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.907429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e21e79-aade-44f1-8ce1-64901f0ec359 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.912413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.913100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.913384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.913662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.914430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] RBAC: Adding query filter params (type=image) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:13.914767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.916472 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.922784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 494/978] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:13.922784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.933895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0084e41-40d9-47b0-b113-a07ceebae921 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.938968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.939839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.940390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.940676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.949584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.951795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:13.966764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:13.968296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 495/979] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:13.974332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:13.985282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938923-8d54-4137-9496-ee0fb1220824 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:13.990202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c034164-3b0e-4b2c-b060-e7a543158c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:13.990942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c034164-3b0e-4b2c-b060-e7a543158c33 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:13.991228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c034164-3b0e-4b2c-b060-e7a543158c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:13.991689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c034164-3b0e-4b2c-b060-e7a543158c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:13.993029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c034164-3b0e-4b2c-b060-e7a543158c33 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:13.993353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c034164-3b0e-4b2c-b060-e7a543158c33 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:13.995313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c034164-3b0e-4b2c-b060-e7a543158c33 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:14.012321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 485/980] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:35:13 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:14.017507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 496/981] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:16.175113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28fea-783a-4243-9298-aef56090bf05 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.175634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28fea-783a-4243-9298-aef56090bf05 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.175712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28fea-783a-4243-9298-aef56090bf05 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.177719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 486/982] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:16.183446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c699f3d-bfe4-437a-a74b-2eb64a809b92 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.183919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c699f3d-bfe4-437a-a74b-2eb64a809b92 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.183999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c699f3d-bfe4-437a-a74b-2eb64a809b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.203267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-3c699f3d-bfe4-437a-a74b-2eb64a809b92 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:16.204481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3c699f3d-bfe4-437a-a74b-2eb64a809b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:16.222224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 497/983] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:16 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:16.225622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f056-ac67-49d6-a772-21e0bc1adc26 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.225911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f056-ac67-49d6-a772-21e0bc1adc26 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.226188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f056-ac67-49d6-a772-21e0bc1adc26 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.228751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 487/984] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:16.234077 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4738-39f3-41a3-84dd-c3e798bbfbaf None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.234363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4738-39f3-41a3-84dd-c3e798bbfbaf None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.234636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4738-39f3-41a3-84dd-c3e798bbfbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.247415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42f056-ac67-49d6-a772-21e0bc1adc26 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.260406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42f056-ac67-49d6-a772-21e0bc1adc26 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.265282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.266113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.266394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.266829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.267535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.269192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.283275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 17 09:35:16.284790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 488/985] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:16.291308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.301664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52338e5-d99c-404f-bac4-986284d7a0ca admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.306865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.307549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.307831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.308105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.308976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:16.309285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.310985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.316991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 489/986] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:16.323035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.335010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5a8e-bb99-4523-ad7c-4e389258dd42 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.339233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaaadd-0d89-4d2b-8234-dec6083e5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.339911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaaadd-0d89-4d2b-8234-dec6083e5c74 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.340193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaaadd-0d89-4d2b-8234-dec6083e5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.340467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaaadd-0d89-4d2b-8234-dec6083e5c74 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.341202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaaadd-0d89-4d2b-8234-dec6083e5c74 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:16.341509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaaadd-0d89-4d2b-8234-dec6083e5c74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.343170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaaadd-0d89-4d2b-8234-dec6083e5c74 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.348931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 490/987] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:16.350935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c669-c09c-4222-ad5f-1a90df2dc950 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.350935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c669-c09c-4222-ad5f-1a90df2dc950 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.351438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c669-c09c-4222-ad5f-1a90df2dc950 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.354461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 491/988] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:16.354801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc315-e592-4112-9a2b-7c5a9109eed2 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.355090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc315-e592-4112-9a2b-7c5a9109eed2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.355362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc315-e592-4112-9a2b-7c5a9109eed2 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.357175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 492/989] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:16.357964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc315-e592-4112-9a2b-7c5a9109eed2 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.370865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e9fe4738-39f3-41a3-84dd-c3e798bbfbaf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:16.370986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc315-e592-4112-9a2b-7c5a9109eed2 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.372058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e9fe4738-39f3-41a3-84dd-c3e798bbfbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:16.375290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9de339-30cb-4db0-b2bc-cb860dcfab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.375938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9de339-30cb-4db0-b2bc-cb860dcfab4c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.376221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9de339-30cb-4db0-b2bc-cb860dcfab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.376495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9de339-30cb-4db0-b2bc-cb860dcfab4c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.377286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9de339-30cb-4db0-b2bc-cb860dcfab4c admin admin] RBAC: Adding query filter params (interface=admin, service_id=43283d80a5da49f2bfb42cdc75d1f374, region_id=RegionOne) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:16.377596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9de339-30cb-4db0-b2bc-cb860dcfab4c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.379198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9de339-30cb-4db0-b2bc-cb860dcfab4c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.379738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 498/990] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:16 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:16.385232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 493/991] 10.222.0.88 () {56 vars in 1270 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/endpoints?service_id=43283d80a5da49f2bfb42cdc75d1f374&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:16.386821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327b1b-b7ad-49df-9874-52560d78b2b8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.387268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327b1b-b7ad-49df-9874-52560d78b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.387682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327b1b-b7ad-49df-9874-52560d78b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.389045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b1c03-087f-4c2a-a92d-65534ca5e0bb None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.389526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b1c03-087f-4c2a-a92d-65534ca5e0bb None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.390022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b1c03-087f-4c2a-a92d-65534ca5e0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.409778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e71b1c03-087f-4c2a-a92d-65534ca5e0bb None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:16.409971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-98327b1b-b7ad-49df-9874-52560d78b2b8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:16.411050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e71b1c03-087f-4c2a-a92d-65534ca5e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:16.411416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-98327b1b-b7ad-49df-9874-52560d78b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:16.418796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 499/992] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:16 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:16.430943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 494/993] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:16 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:16.431094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b1c03-087f-4c2a-a92d-65534ca5e0bb None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.431173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98327b1b-b7ad-49df-9874-52560d78b2b8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.431173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98327b1b-b7ad-49df-9874-52560d78b2b8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.433968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.434618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.434932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.435231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.435945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.437637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.438148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b1c03-087f-4c2a-a92d-65534ca5e0bb None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.447444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.448291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.449642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.458635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.458635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.458635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.462361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 500/994] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services => generated 1727 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:35:16.463255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.473597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32354d65-b0b9-4326-858b-3459d1bcdfb6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.478444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.479298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.479576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.479849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.480526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.482155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.494033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 17 09:35:16.507787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 501/995] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:16.507787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.507787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319f4ce-b9dd-451f-b8e8-d934d238a05b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.512113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.512804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.513084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.513356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.514086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.516005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.517403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.common [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 17 09:35:16.593033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.sql.core [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 17 09:35:16.593033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 17 09:35:16.593033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [parameters: {'user_id': '69b6e41e7e1e4ad680cd2ae66bb645a0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 17 09:35:16.593033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 17 09:35:16.608246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 17 09:35:16.609673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 502/996] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:35:16 2022] POST /identity/v3/users => generated 160 bytes in 114 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:16.610777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.621074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6186-20b0-42fa-adcc-ad5a21f7d8b0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.625878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.626542 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.626860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.627135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.627858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:16.628160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.630020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.638882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 503/997] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:16.639684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.650643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c6b60-3584-4b47-bb13-f1433f6c2556 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.654479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 495/998] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:35:16 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:16.655439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.666430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.666904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0de83-f019-4222-aea2-bbf470e1dce1 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.667386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.667567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.667834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.672067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.672891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.673307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.673679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.674550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:16.675048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.676793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.677280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.679502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.689677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 496/999] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:16.696912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 17 09:35:16.697137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.697331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 504/1000] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:16.703278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.706864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ca98-7d37-451e-96c2-55f48a389f0c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.712443 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.719607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.719607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.719607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.719607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] RBAC: Adding query filter params (interface=public, service_id=0a2a6b77ce9c4b3f863b3d1d39e8ac96, region_id=RegionOne) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:16.719989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222b62-34d2-4591-b1c0-38922967b5c7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.720167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.720167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.720322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d064a1a-115f-4620-81ab-327aef34ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.720322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064a1a-115f-4620-81ab-327aef34ea84 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.720545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064a1a-115f-4620-81ab-327aef34ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.720839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064a1a-115f-4620-81ab-327aef34ea84 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.721626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064a1a-115f-4620-81ab-327aef34ea84 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:16.721929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064a1a-115f-4620-81ab-327aef34ea84 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.723886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064a1a-115f-4620-81ab-327aef34ea84 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.727379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 497/1001] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/endpoints?service_id=0a2a6b77ce9c4b3f863b3d1d39e8ac96&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:16.729668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:16.739868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32e0c-75b1-4a89-baf8-c1bf71894f67 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:16.745404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecc8cb-70e3-48f4-b829-4ea812c6c257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:16.746276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecc8cb-70e3-48f4-b829-4ea812c6c257 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:16.746707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecc8cb-70e3-48f4-b829-4ea812c6c257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:16.747114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecc8cb-70e3-48f4-b829-4ea812c6c257 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:16.747950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecc8cb-70e3-48f4-b829-4ea812c6c257 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:16.749836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecc8cb-70e3-48f4-b829-4ea812c6c257 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:16.764073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 498/1002] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:35:16.765143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 505/1003] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Jan 17 09:35:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:18.732226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4507-3839-4f35-9615-280cb0085925 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:18.732741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4507-3839-4f35-9615-280cb0085925 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:18.732818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4507-3839-4f35-9615-280cb0085925 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:18.734696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 499/1004] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:18.740698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebc47-2745-4d19-8bdc-39eeba7cf007 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:18.741178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebc47-2745-4d19-8bdc-39eeba7cf007 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:18.741252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebc47-2745-4d19-8bdc-39eeba7cf007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:18.761153 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-701ebc47-2745-4d19-8bdc-39eeba7cf007 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:18.762939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-701ebc47-2745-4d19-8bdc-39eeba7cf007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:18.772809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 506/1005] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:18 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:18.798029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4507-3839-4f35-9615-280cb0085925 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:18.812805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4507-3839-4f35-9615-280cb0085925 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:18.817267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:18.818066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:18.818346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:18.818621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:18.819318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:18.820949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:18.832811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 17 09:35:18.834153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 500/1006] 10.222.0.88 () {56 vars in 1147 bytes} [Mon Jan 17 09:35:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:18.840065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebc47-2745-4d19-8bdc-39eeba7cf007 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:18.852228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebc47-2745-4d19-8bdc-39eeba7cf007 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:18.859391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:18.860605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:18.861418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:18.861886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:18.863312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:18.863902 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:18.866370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:18.873079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 507/1007] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:18.879079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:18.891002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609802-2297-4a8a-8388-84178d175991 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:18.895743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992b471-b604-4d04-a5cb-70739864b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:18.896478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992b471-b604-4d04-a5cb-70739864b37e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:18.896844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992b471-b604-4d04-a5cb-70739864b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:18.897184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992b471-b604-4d04-a5cb-70739864b37e admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:18.897967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992b471-b604-4d04-a5cb-70739864b37e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:18.898331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992b471-b604-4d04-a5cb-70739864b37e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:18.900350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992b471-b604-4d04-a5cb-70739864b37e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:18.906073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 501/1008] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Jan 17 09:35:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:18.912058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:18.922785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b9df3-5e33-447c-8703-cb3b5aa4e6f1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:18.927225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306d47b-eadc-4949-83c2-3f7c88ab1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:18.927873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d47b-eadc-4949-83c2-3f7c88ab1640 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:18.928150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d47b-eadc-4949-83c2-3f7c88ab1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:18.928420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306d47b-eadc-4949-83c2-3f7c88ab1640 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:18.929174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306d47b-eadc-4949-83c2-3f7c88ab1640 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:18.931432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306d47b-eadc-4949-83c2-3f7c88ab1640 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.017887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5d34-d2ee-48bc-8b6e-6ce23e56afe6 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.018095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5d34-d2ee-48bc-8b6e-6ce23e56afe6 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.018373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5d34-d2ee-48bc-8b6e-6ce23e56afe6 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.020324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 502/1009] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:19.026211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc46f-4054-4b4f-9cf3-9ab3db106517 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.026547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc46f-4054-4b4f-9cf3-9ab3db106517 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.030291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc46f-4054-4b4f-9cf3-9ab3db106517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.039038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 508/1010] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:19.043931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a177-39d5-4a1a-b3ce-36d31125dd76 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.044305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a177-39d5-4a1a-b3ce-36d31125dd76 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.044477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a177-39d5-4a1a-b3ce-36d31125dd76 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.046777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 509/1011] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:19.052959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a27fb-c678-4fa7-ad9c-31fd6c219b52 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.053270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a27fb-c678-4fa7-ad9c-31fd6c219b52 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.053503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a27fb-c678-4fa7-ad9c-31fd6c219b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.054430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7cdcc46f-4054-4b4f-9cf3-9ab3db106517 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:19.055754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7cdcc46f-4054-4b4f-9cf3-9ab3db106517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:19.073525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1f5a27fb-c678-4fa7-ad9c-31fd6c219b52 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:19.074871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1f5a27fb-c678-4fa7-ad9c-31fd6c219b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:19.075816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 503/1012] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:19 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:19.082994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 510/1013] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:19 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:19.101075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcc46f-4054-4b4f-9cf3-9ab3db106517 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.108862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a27fb-c678-4fa7-ad9c-31fd6c219b52 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.115199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcc46f-4054-4b4f-9cf3-9ab3db106517 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.117977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a27fb-c678-4fa7-ad9c-31fd6c219b52 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.120475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.121370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.121755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.122026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.122813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.123213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.124014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.124297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.124555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.124650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] PATH_INFO: `/v3/services/image` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.125232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.126889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.137435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 17 09:35:19.138973 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 504/1014] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:19.141581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 17 09:35:19.147666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 511/1015] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:19.147887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.149304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.156992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebf54-25e0-42bc-b2fc-d64c2a7b9295 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.161015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a177955-fe42-4d01-a7de-86e7bc5a2e5c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.162537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.163245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.163526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.163798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.165146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] RBAC: Adding query filter params (name=compute) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:19.165448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.166652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.167095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.167411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.167638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.167913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.168654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] RBAC: Adding query filter params (name=image) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:19.168965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.170596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.173784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 505/1016] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:19.182851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 512/1017] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:19.183082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.184048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.189955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38359a-833b-4713-9277-5253dbab52af admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.194433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135cf9-8d48-4028-bac8-9c45f548ef30 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.194582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.195201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.195512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.195789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.196504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] RBAC: Adding query filter params (type=compute) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:19.196792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.198370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.199272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.199945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.200226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.200498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.201219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] RBAC: Adding query filter params (type=image) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:19.201527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.203853 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.205349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 506/1018] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:19.212436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.213241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 513/1019] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:19.219634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.223445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4edf9d-6911-4b5a-a3ed-a694883748be admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.228780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983b35-8b6a-4b49-81fe-4cddd8e910d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.229428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983b35-8b6a-4b49-81fe-4cddd8e910d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.229702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc552e-ce45-42a8-aba4-2ea9a81a09d4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.229807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983b35-8b6a-4b49-81fe-4cddd8e910d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.229968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983b35-8b6a-4b49-81fe-4cddd8e910d4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.230709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983b35-8b6a-4b49-81fe-4cddd8e910d4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.232309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983b35-8b6a-4b49-81fe-4cddd8e910d4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.234618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.235476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.238250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.238250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.238250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] RBAC: Adding query filter params (interface=public, service_id=948fec416e6c4fb8820eb84a1b6999fd, region_id=RegionOne) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:19.238250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.238779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.245110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 514/1020] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/endpoints?service_id=948fec416e6c4fb8820eb84a1b6999fd&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:19.250754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:19.261204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68b286-284e-4931-93f3-3a28d818062b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:19.265750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c08e93-5f70-4398-b134-f2b8ac28509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:19.266501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c08e93-5f70-4398-b134-f2b8ac28509b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:19.266840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c08e93-5f70-4398-b134-f2b8ac28509b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:19.267121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c08e93-5f70-4398-b134-f2b8ac28509b admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:19.267809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c08e93-5f70-4398-b134-f2b8ac28509b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:19.269439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c08e93-5f70-4398-b134-f2b8ac28509b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:19.276511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 515/1021] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:35:19 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:35:19.340279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 507/1022] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:35:21.276125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae83c2-92b7-4483-bae2-bc674d104189 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.276663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae83c2-92b7-4483-bae2-bc674d104189 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.276663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae83c2-92b7-4483-bae2-bc674d104189 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.278680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 516/1023] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:21.284947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8992-c7b4-4324-a0f8-87ed88326ea7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.285495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8992-c7b4-4324-a0f8-87ed88326ea7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.285730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8992-c7b4-4324-a0f8-87ed88326ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.304114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-051f8992-c7b4-4324-a0f8-87ed88326ea7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:21.305965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-051f8992-c7b4-4324-a0f8-87ed88326ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:21.323573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 508/1024] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:21 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:21.347452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae83c2-92b7-4483-bae2-bc674d104189 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.360245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae83c2-92b7-4483-bae2-bc674d104189 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.367215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f1f3-4c7c-457c-8415-3fda14b718e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.367215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f1f3-4c7c-457c-8415-3fda14b718e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.367215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f1f3-4c7c-457c-8415-3fda14b718e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.367215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f1f3-4c7c-457c-8415-3fda14b718e8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.368888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11f1f3-4c7c-457c-8415-3fda14b718e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.370747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11f1f3-4c7c-457c-8415-3fda14b718e8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.372705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 517/1025] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:21.378338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8992-c7b4-4324-a0f8-87ed88326ea7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.388041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8992-c7b4-4324-a0f8-87ed88326ea7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.392685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.393335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.393618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.393890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.394609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.396535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.502712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06127d3-a4e0-4e28-b6a7-64ab362096cf None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.503170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06127d3-a4e0-4e28-b6a7-64ab362096cf None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.503563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06127d3-a4e0-4e28-b6a7-64ab362096cf None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.505427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 518/1026] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:21.511607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c435d-66f6-426d-b0cb-3b3ea1802fec None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.511821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c435d-66f6-426d-b0cb-3b3ea1802fec None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.512149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c435d-66f6-426d-b0cb-3b3ea1802fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.529606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1d8c435d-66f6-426d-b0cb-3b3ea1802fec None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:21.530696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1d8c435d-66f6-426d-b0cb-3b3ea1802fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:21.538562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 519/1027] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:21 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:21.562041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c435d-66f6-426d-b0cb-3b3ea1802fec None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.571824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c435d-66f6-426d-b0cb-3b3ea1802fec None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.576334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b9ba7-ba10-4d08-8b3b-6eeeee4c9863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.577152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9ba7-ba10-4d08-8b3b-6eeeee4c9863 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.577429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9ba7-ba10-4d08-8b3b-6eeeee4c9863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.577694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9ba7-ba10-4d08-8b3b-6eeeee4c9863 admin admin] PATH_INFO: `/v3/services/image` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.578356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b9ba7-ba10-4d08-8b3b-6eeeee4c9863 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.579975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b9ba7-ba10-4d08-8b3b-6eeeee4c9863 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.591021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 509/1028] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:35:21 2022] POST /identity/v3/projects => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:21.591226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b11b9ba7-ba10-4d08-8b3b-6eeeee4c9863 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 17 09:35:21.592034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 520/1029] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:21.598664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.667247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d370f-d16a-4636-a3ac-4f3969b113ac admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.672117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.672790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.673069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.673381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.674199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] RBAC: Adding query filter params (name=image) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:21.674515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.676204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.686792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 510/1030] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:21.687931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.688085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5d108-6b9c-4625-8da0-81d81b3c7085 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.688430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5d108-6b9c-4625-8da0-81d81b3c7085 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.688716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5d108-6b9c-4625-8da0-81d81b3c7085 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.690664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 521/1031] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:21.696434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caebc4-a45d-4000-b3b6-2ffc2b8dd2e9 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.698224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caebc4-a45d-4000-b3b6-2ffc2b8dd2e9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.698224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caebc4-a45d-4000-b3b6-2ffc2b8dd2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.698376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277ba26-20f6-43be-90e8-75e0cef2051d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.703698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.704393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.704673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.704942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.705847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] RBAC: Adding query filter params (type=image) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:21.706152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.707812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.713537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 511/1032] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:21.718611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-50caebc4-a45d-4000-b3b6-2ffc2b8dd2e9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:21.719236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.719855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-50caebc4-a45d-4000-b3b6-2ffc2b8dd2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:21.728630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 522/1033] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:21 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:21.730089 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a739a-a270-4dc8-b579-906091e643fa admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.737834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.738606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.738922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.739209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.740003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.741616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.753349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caebc4-a45d-4000-b3b6-2ffc2b8dd2e9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.762442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caebc4-a45d-4000-b3b6-2ffc2b8dd2e9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.767868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.768645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.768922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.769192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.780550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:21.787956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 17 09:35:21.789759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 523/1034] 10.222.0.88 () {56 vars in 1141 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:21.795750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.808381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4346-8fdd-4f62-ac9b-5774ffd898b3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.813564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.814333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.818588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.818588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.818588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:21.818588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.818588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.825966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 524/1035] 10.222.0.88 () {56 vars in 1136 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:21.831470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.840768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b80f0-07e8-43b0-a1b8-ac0833165687 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.845370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.846135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.846406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.846670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.857459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.860126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.863287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 512/1036] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:35:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:35:21.882053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:21.883540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 525/1037] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:21.889388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.911585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89f1d-c6fe-4248-b115-3eaab91fc1ed admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.916943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.917631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.917923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.918228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.919153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:21.919457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.921106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.935389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 513/1038] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:21.941138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:21.951424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ff7e-7b6a-43dd-a85c-09325fad02c7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:21.956504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:21.957393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:21.957743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:21.958024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:21.966696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:21.968768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:21.984671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:35:21.986273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 526/1039] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:21.992127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:22.003273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6163780-3f34-4524-9d79-b8466a345148 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:22.008045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:22.008809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:22.009165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:22.009511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:22.010437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:22.010872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:22.012855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:22.032735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 514/1040] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:35:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:22.038666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:22.049293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde0a30-3428-418f-a674-c7e604b90ec0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:22.053914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:22.054565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:22.054907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:22.055181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:22.063529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:22.065294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:22.074939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 527/1041] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:22 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:22.081032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:22.091559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30325853-5c83-4931-a887-fb5c0c5c610e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:22.096235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:22.097018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:22.097301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:22.097573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:22.108719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:22.110540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:22.127448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:22.128809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 515/1042] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:22.134264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:22.143310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64e14a-6736-4bc1-9e79-d567b89297dd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:22.147886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:22.149069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:22.149352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:22.149625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:22.150358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:22.150656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:22.152264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:22.164037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 528/1043] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:22.169990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:22.179510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762a37e-8e3c-4b28-9dd9-38e3dda3fde2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:22.184241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:22.185019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:22.185304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:22.185580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:22.192768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:22.194713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:22.207636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:22.208983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 516/1044] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:22.215204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:22.224949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5886dd-a4a9-4f2d-9dc4-a500ebe9efe0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:22.230204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcbe79-897f-4a30-b208-01edb22a75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:22.230990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcbe79-897f-4a30-b208-01edb22a75df admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:22.231339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcbe79-897f-4a30-b208-01edb22a75df admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:22.231681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcbe79-897f-4a30-b208-01edb22a75df admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:22.232544 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcbe79-897f-4a30-b208-01edb22a75df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:22.232919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcbe79-897f-4a30-b208-01edb22a75df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:22.234876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcbe79-897f-4a30-b208-01edb22a75df admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:22.247436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 529/1045] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:22.253723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:22.264202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4dc6a-666d-413e-9ec0-a9558511c906 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:22.268665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375315d5-a584-418c-9c78-d946f71d3e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:22.269298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375315d5-a584-418c-9c78-d946f71d3e73 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:22.269579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375315d5-a584-418c-9c78-d946f71d3e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:22.269857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375315d5-a584-418c-9c78-d946f71d3e73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:22.270693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375315d5-a584-418c-9c78-d946f71d3e73 admin admin] RBAC: Adding query filter params (role.id=a6cf142bcc2a4550b1b2b07a8cce43b6, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=3d4b284f0c1348bb9baa47b4c531821e) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:22.271059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375315d5-a584-418c-9c78-d946f71d3e73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:22.272893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375315d5-a584-418c-9c78-d946f71d3e73 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:22.279005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 517/1046] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:22 2022] GET /identity/v3/role_assignments?user.id=3d4b284f0c1348bb9baa47b4c531821e&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=a6cf142bcc2a4550b1b2b07a8cce43b6 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:23.874583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6c3c-21f4-432f-a117-2335319d34d9 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:23.875159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6c3c-21f4-432f-a117-2335319d34d9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:23.875242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6c3c-21f4-432f-a117-2335319d34d9 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:23.876998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 530/1047] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:23.882917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21cef1-d712-47ef-9169-270cdaecd82b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:23.883439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21cef1-d712-47ef-9169-270cdaecd82b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:23.883439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21cef1-d712-47ef-9169-270cdaecd82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:23.903177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3f21cef1-d712-47ef-9169-270cdaecd82b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:23.904391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3f21cef1-d712-47ef-9169-270cdaecd82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:23.912761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 518/1048] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:35:23.939188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6c3c-21f4-432f-a117-2335319d34d9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:23.951497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6c3c-21f4-432f-a117-2335319d34d9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:23.955872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eb0e0-34a3-44bc-9f94-8c8d7e4b6094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:23.956655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb0e0-34a3-44bc-9f94-8c8d7e4b6094 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:23.956931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb0e0-34a3-44bc-9f94-8c8d7e4b6094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:23.957199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb0e0-34a3-44bc-9f94-8c8d7e4b6094 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:23.958377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eb0e0-34a3-44bc-9f94-8c8d7e4b6094 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:23.960089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eb0e0-34a3-44bc-9f94-8c8d7e4b6094 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:23.961863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 531/1049] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:23.967427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21cef1-d712-47ef-9169-270cdaecd82b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:23.976400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21cef1-d712-47ef-9169-270cdaecd82b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:23.982203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:23.982908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:23.983191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:23.983462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:23.984193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:23.986096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.121791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218e6a-e5e1-48f6-81cf-b096a498f992 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.122186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218e6a-e5e1-48f6-81cf-b096a498f992 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.122470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218e6a-e5e1-48f6-81cf-b096a498f992 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.124302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 532/1050] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:24.129745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cc9b9-816c-4df6-b2cb-4e940ca8c2b7 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.129994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cc9b9-816c-4df6-b2cb-4e940ca8c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.130236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cc9b9-816c-4df6-b2cb-4e940ca8c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.137090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 519/1051] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:35:23 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:24.150230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-dc0cc9b9-816c-4df6-b2cb-4e940ca8c2b7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:24.151469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-dc0cc9b9-816c-4df6-b2cb-4e940ca8c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:24.160017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 533/1052] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:24.183243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.193538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f9465-a695-4ecd-9649-542e173a8a58 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.199752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba44e61-822a-4413-b195-47580844c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.200486 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44e61-822a-4413-b195-47580844c6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.200772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44e61-822a-4413-b195-47580844c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.201049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44e61-822a-4413-b195-47580844c6d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.210130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba44e61-822a-4413-b195-47580844c6d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.212694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba44e61-822a-4413-b195-47580844c6d1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.222698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 520/1053] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:24.228828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cc9b9-816c-4df6-b2cb-4e940ca8c2b7 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.238494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cc9b9-816c-4df6-b2cb-4e940ca8c2b7 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.243230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec680a-2451-4a4e-915b-cc0add5369cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.244049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec680a-2451-4a4e-915b-cc0add5369cf admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.244334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec680a-2451-4a4e-915b-cc0add5369cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.244612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec680a-2451-4a4e-915b-cc0add5369cf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.245917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec680a-2451-4a4e-915b-cc0add5369cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.247726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec680a-2451-4a4e-915b-cc0add5369cf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.249494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 534/1054] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:24.495388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996a65-54f4-446c-958d-c2c5f7afcd93 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.495757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996a65-54f4-446c-958d-c2c5f7afcd93 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.495951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996a65-54f4-446c-958d-c2c5f7afcd93 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.497710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 521/1055] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:24.503501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0024bc-094c-4d8c-b1c1-e0e08aaa4d71 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.503788 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0024bc-094c-4d8c-b1c1-e0e08aaa4d71 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.504064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0024bc-094c-4d8c-b1c1-e0e08aaa4d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.522993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9c0024bc-094c-4d8c-b1c1-e0e08aaa4d71 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:24.524303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9c0024bc-094c-4d8c-b1c1-e0e08aaa4d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:24.532603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 535/1056] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:24.557231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996a65-54f4-446c-958d-c2c5f7afcd93 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.569992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996a65-54f4-446c-958d-c2c5f7afcd93 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.574933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.575728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.576008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.576279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.587295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:24.594628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 17 09:35:24.595822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 522/1057] 10.222.0.88 () {56 vars in 1141 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:24.601690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0024bc-094c-4d8c-b1c1-e0e08aaa4d71 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.610617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0024bc-094c-4d8c-b1c1-e0e08aaa4d71 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.615161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.615818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.616098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.616372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.617657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:24.617972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.619745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.628230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 536/1058] 10.222.0.88 () {56 vars in 1136 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:24.634702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.644375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b735-6204-4917-8695-bc25bcb4ce62 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.648908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.649678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.649961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.650231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.660776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.662606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.679552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:24.681439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 523/1059] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:24.687080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.696937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4eca8-d114-4850-bb60-4b8ad291458e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.701437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.702105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.702385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.702656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.703422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:24.703724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.705327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.716666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 537/1060] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:24.722060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.732107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442528-c54f-48a4-831e-f9dea79acb70 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.736531 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.737294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.737570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.737834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.745546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.747504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.760777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:35:24.761896 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 524/1061] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:24.767586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.777288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b992-f761-45ce-af7e-a5440f939e34 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.782321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.783008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.783288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.783559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.784398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:24.784704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.786533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.816520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 538/1062] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:24.823097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.832509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d5447-c59b-4785-807a-0d34a68d83e6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.836919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.837727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.838007 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.838296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.848342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.850788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.867777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:24.869152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 525/1063] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:24.874630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.884405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fa3f2-4c2c-4f48-ad4c-711f6f675b81 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.889055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.889793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.890135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.890474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.891315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:24.891707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.893370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.904923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 539/1064] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:24.910765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.921065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8f1db-2bfe-48d8-9668-477f006e8fb0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.925585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.926373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.926656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.926981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.934428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.936408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.948945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:24.950263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 526/1065] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:24.955905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:24.965673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090613ce-9e1d-4501-ae8a-ecc69f79d24f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:24.970230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60a469-deaf-4c54-b02e-fb9e69b252e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:24.970934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a469-deaf-4c54-b02e-fb9e69b252e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:24.971228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a469-deaf-4c54-b02e-fb9e69b252e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:24.971507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60a469-deaf-4c54-b02e-fb9e69b252e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:24.972302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a469-deaf-4c54-b02e-fb9e69b252e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:24.972612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a469-deaf-4c54-b02e-fb9e69b252e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:24.974452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60a469-deaf-4c54-b02e-fb9e69b252e1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:24.986929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 540/1066] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:24.993415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:25.005040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd84203-6804-4427-a095-cfaec0d9e429 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:25.009534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee245d-d03c-434e-b361-cd266d4c8a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:25.010393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee245d-d03c-434e-b361-cd266d4c8a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:25.010674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee245d-d03c-434e-b361-cd266d4c8a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:25.010982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee245d-d03c-434e-b361-cd266d4c8a7f admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/3d4b284f0c1348bb9baa47b4c531821e/roles/a6cf142bcc2a4550b1b2b07a8cce43b6` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:25.013201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee245d-d03c-434e-b361-cd266d4c8a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=3d4b284f0c1348bb9baa47b4c531821e, role_id=a6cf142bcc2a4550b1b2b07a8cce43b6)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:25.015878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee245d-d03c-434e-b361-cd266d4c8a7f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:25.102280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 527/1067] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:35:24 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/3d4b284f0c1348bb9baa47b4c531821e/roles/a6cf142bcc2a4550b1b2b07a8cce43b6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:35:26.446799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f85b4-5f7a-42b7-98e6-1e2d40f2a343 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.447311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f85b4-5f7a-42b7-98e6-1e2d40f2a343 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.447403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f85b4-5f7a-42b7-98e6-1e2d40f2a343 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.449111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 541/1068] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:26.454465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611312-ac62-4824-a2a0-45fb893b8aee None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.454903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611312-ac62-4824-a2a0-45fb893b8aee None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.455039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611312-ac62-4824-a2a0-45fb893b8aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.472215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4b611312-ac62-4824-a2a0-45fb893b8aee None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:26.473384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4b611312-ac62-4824-a2a0-45fb893b8aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:26.528740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 528/1069] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:26.553142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f85b4-5f7a-42b7-98e6-1e2d40f2a343 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:26.567251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f85b4-5f7a-42b7-98e6-1e2d40f2a343 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:26.571826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:26.572610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.572890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.573158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.583627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:26.590869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:35:26.592113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 542/1070] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:26.598419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611312-ac62-4824-a2a0-45fb893b8aee None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:26.608046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611312-ac62-4824-a2a0-45fb893b8aee None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:26.612576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:26.613230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.613509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.613780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.614537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:26.614875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:26.616457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:26.625113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 529/1071] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:26.630488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:26.640890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c459fc-cd58-4bc5-b761-a9cc7e2cf546 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:26.645495 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:26.646348 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.646631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.646939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] PATH_INFO: `/v3/users/6483f1d17ca749fc855f29fd3aa66984` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.660673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] RBAC: Authorizing `identity:get_user(user_id=6483f1d17ca749fc855f29fd3aa66984)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:26.662947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:26.665165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 543/1072] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:26 2022] GET /identity/v3/users/6483f1d17ca749fc855f29fd3aa66984 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:26.671203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:26.680773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938f3db-0a45-40a1-9279-2ee5c83d952f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:26.685221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:26.685851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.686132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.686403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.694622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:26.696425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:26.705110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 530/1073] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:26.711391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:26.720989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde65fd-2397-49b0-8f1f-d1f44c1dac53 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:26.725620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3caef0-e45f-4240-be44-a2408f847aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:26.727065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3caef0-e45f-4240-be44-a2408f847aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.727374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3caef0-e45f-4240-be44-a2408f847aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.727647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3caef0-e45f-4240-be44-a2408f847aa0 admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.728824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3caef0-e45f-4240-be44-a2408f847aa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=53ff7a4f23bb449b8a34d21b44349a85)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:26.730897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3caef0-e45f-4240-be44-a2408f847aa0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:26.732560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 544/1074] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:26 2022] GET /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:26.738649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:26.747457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78c6f1-3376-4cae-acef-458bbddb67a2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:26.752021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72a87-8cbb-45fd-b501-3e76268da340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:26.752652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72a87-8cbb-45fd-b501-3e76268da340 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:26.752928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72a87-8cbb-45fd-b501-3e76268da340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:26.753201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72a87-8cbb-45fd-b501-3e76268da340 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:26.754032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72a87-8cbb-45fd-b501-3e76268da340 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=53ff7a4f23bb449b8a34d21b44349a85, user.id=6483f1d17ca749fc855f29fd3aa66984) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:26.754337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72a87-8cbb-45fd-b501-3e76268da340 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:26.756187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72a87-8cbb-45fd-b501-3e76268da340 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:26.761767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 531/1075] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:26 2022] GET /identity/v3/role_assignments?user.id=6483f1d17ca749fc855f29fd3aa66984&scope.project.id=53ff7a4f23bb449b8a34d21b44349a85&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:27.254802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e2d1-2731-48e8-80b8-d060bdd774e1 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.255143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e2d1-2731-48e8-80b8-d060bdd774e1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.255430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e2d1-2731-48e8-80b8-d060bdd774e1 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.257292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 545/1076] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:27.263106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ffa63-2b3e-46d2-b670-87b20f6647f7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.263391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ffa63-2b3e-46d2-b670-87b20f6647f7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.263665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ffa63-2b3e-46d2-b670-87b20f6647f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.281967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-867ffa63-2b3e-46d2-b670-87b20f6647f7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:27.283169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-867ffa63-2b3e-46d2-b670-87b20f6647f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:27.290803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 532/1077] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:27.315169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067e2d1-2731-48e8-80b8-d060bdd774e1 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.327627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067e2d1-2731-48e8-80b8-d060bdd774e1 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.331898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.332679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.335563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.335563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.343726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:27.351013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 17 09:35:27.352223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 546/1078] 10.222.0.88 () {56 vars in 1141 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:27.358182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ffa63-2b3e-46d2-b670-87b20f6647f7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.367768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ffa63-2b3e-46d2-b670-87b20f6647f7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.372556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.373217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.373497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.373770 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.374530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:27.374860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.376449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.385553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 533/1079] 10.222.0.88 () {56 vars in 1136 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:27.391191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.402246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014d8c-3428-448c-9128-71b260b312a1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.406907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.407682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.407970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.408244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.418578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.420493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.437629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:27.438830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 547/1080] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:35:27.444573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.454828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33779dba-847d-43fb-bd62-6e0b7b0eb736 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.459462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.460110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.460393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.460667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.461395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:27.461699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.463341 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.479231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 534/1081] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:27.480559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.489956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee986d-4504-49d6-a1e4-5acaddbdf3c7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.494983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.495988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.496106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.496283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.503980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.506145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.522116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 17 09:35:27.523536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 548/1082] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:27.529211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.539288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505e97-5512-4f9a-9be1-d2161a623bb8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.544032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.544693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.546375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.546375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.546375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:27.546375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.548192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.566133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 535/1083] 10.222.0.88 () {56 vars in 1154 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:27.572684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.582520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e436a4-34e0-450b-b8b8-dd0a779953d7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.587081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.587728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.588010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.588278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.596584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.598371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.607686 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 549/1084] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:27.613458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.623524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813620de-6c21-40af-8845-8736119d7ac8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.628040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.628821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.629098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.629368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.640179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.642202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.659101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:35:27.660497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 536/1085] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:27.666679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.675603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fad7cb-0e0a-4d46-a2ac-471f5e24ae0a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.680755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.681474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.681818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.682178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.683016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:27.683388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.685020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.696226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 550/1086] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:27.702164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.712010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057889ef-9bdd-40de-bb20-c7f3e30a491d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.716665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.717444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.717724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.717993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.725088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.727662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.741318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:35:27.743117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 537/1087] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:27.749399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.759324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e511a38-a69f-4292-ab4a-1d66004f9645 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.763844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f89d2-5da9-4143-8caa-07966a9e709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.764490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f89d2-5da9-4143-8caa-07966a9e709e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.764823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f89d2-5da9-4143-8caa-07966a9e709e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.765098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f89d2-5da9-4143-8caa-07966a9e709e admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.765886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f89d2-5da9-4143-8caa-07966a9e709e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:27.766191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f89d2-5da9-4143-8caa-07966a9e709e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.768131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f89d2-5da9-4143-8caa-07966a9e709e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.780399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 551/1088] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:27.786914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:27.797612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ffb67-21c9-46d4-8b94-0984c94c88ba admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:27.802215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4778e1-96d7-46bd-aa61-3e81ab463a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:27.802880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4778e1-96d7-46bd-aa61-3e81ab463a1b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:27.803163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4778e1-96d7-46bd-aa61-3e81ab463a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:27.803436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4778e1-96d7-46bd-aa61-3e81ab463a1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:27.804266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4778e1-96d7-46bd-aa61-3e81ab463a1b admin admin] RBAC: Adding query filter params (role.id=a6cf142bcc2a4550b1b2b07a8cce43b6, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=3d4b284f0c1348bb9baa47b4c531821e) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:27.804614 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4778e1-96d7-46bd-aa61-3e81ab463a1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:27.806984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4778e1-96d7-46bd-aa61-3e81ab463a1b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:27.812776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 538/1089] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:27 2022] GET /identity/v3/role_assignments?user.id=3d4b284f0c1348bb9baa47b4c531821e&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=a6cf142bcc2a4550b1b2b07a8cce43b6 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:28.928170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4f97-6680-45b2-9cee-0d2a0e7f63ca None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:28.928815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4f97-6680-45b2-9cee-0d2a0e7f63ca None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:28.928917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4f97-6680-45b2-9cee-0d2a0e7f63ca None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:28.931305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 552/1090] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:28.936475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242f5f-978d-4937-b8d0-d01b1e679687 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:28.936931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242f5f-978d-4937-b8d0-d01b1e679687 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:28.937030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242f5f-978d-4937-b8d0-d01b1e679687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:28.955364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-69242f5f-978d-4937-b8d0-d01b1e679687 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:28.956547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-69242f5f-978d-4937-b8d0-d01b1e679687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:28.964178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 539/1091] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:28.987230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4f97-6680-45b2-9cee-0d2a0e7f63ca None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:28.999662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4f97-6680-45b2-9cee-0d2a0e7f63ca None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:29.003954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:29.004717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:29.004988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:29.005251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:29.015764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:29.022479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:35:29.023698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 553/1092] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:29.029392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69242f5f-978d-4937-b8d0-d01b1e679687 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:29.038434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69242f5f-978d-4937-b8d0-d01b1e679687 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:29.043279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:29.043923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:29.044205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:29.044481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:29.045235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:29.045541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:29.047149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:29.055706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 540/1093] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:29.061155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:29.071111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa01578-7b11-47bb-9991-58010d2ba4b7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:29.075505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:29.076334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:29.076606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:29.076870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] PATH_INFO: `/v3/users/6483f1d17ca749fc855f29fd3aa66984` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:29.078056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] RBAC: Authorizing `identity:get_user(user_id=6483f1d17ca749fc855f29fd3aa66984)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:29.080171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:29.081700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 554/1094] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:29 2022] GET /identity/v3/users/6483f1d17ca749fc855f29fd3aa66984 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:29.086968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:29.096303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f5a24-d30f-4ee3-ba15-61b5d0ae98e3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:29.100812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb13f2-844c-4a48-b583-fbda03b804e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:29.101634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb13f2-844c-4a48-b583-fbda03b804e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:29.101987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb13f2-844c-4a48-b583-fbda03b804e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:29.102264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb13f2-844c-4a48-b583-fbda03b804e0 admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:29.103417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb13f2-844c-4a48-b583-fbda03b804e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=53ff7a4f23bb449b8a34d21b44349a85)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:29.105436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb13f2-844c-4a48-b583-fbda03b804e0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:29.107080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 541/1095] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:29 2022] GET /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:29.112366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:29.122525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd543c-2522-475f-9d25-5dc8ff3338bf admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:29.126899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96f02b-3015-4be9-8453-058cf2a33175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:29.127730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96f02b-3015-4be9-8453-058cf2a33175 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:29.128003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96f02b-3015-4be9-8453-058cf2a33175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:29.128268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96f02b-3015-4be9-8453-058cf2a33175 admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85/users/6483f1d17ca749fc855f29fd3aa66984/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:29.130196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96f02b-3015-4be9-8453-058cf2a33175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ff7a4f23bb449b8a34d21b44349a85, user_id=6483f1d17ca749fc855f29fd3aa66984, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:29.133659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96f02b-3015-4be9-8453-058cf2a33175 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:29.335481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 555/1096] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:35:29 2022] PUT /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85/users/6483f1d17ca749fc855f29fd3aa66984/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:35:31.494898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed3518-5c30-4670-8be0-59ddbab32e6e None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.495402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed3518-5c30-4670-8be0-59ddbab32e6e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.495518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed3518-5c30-4670-8be0-59ddbab32e6e None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.497203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 542/1097] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:31.502326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031f51-7a55-4978-baca-60ec920e7704 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.502768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031f51-7a55-4978-baca-60ec920e7704 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.502904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031f51-7a55-4978-baca-60ec920e7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.520128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f6031f51-7a55-4978-baca-60ec920e7704 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:31.521564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f6031f51-7a55-4978-baca-60ec920e7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:31.579148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 556/1098] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:31.605660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed3518-5c30-4670-8be0-59ddbab32e6e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:31.617579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed3518-5c30-4670-8be0-59ddbab32e6e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:31.622117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:31.622871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.623156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.623431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.634544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:31.641587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:35:31.642766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 543/1099] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:31.649396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031f51-7a55-4978-baca-60ec920e7704 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:31.658504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031f51-7a55-4978-baca-60ec920e7704 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:31.663115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:31.664932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.664932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.664932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.664932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:31.665332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:31.666921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:31.674963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 557/1100] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:31.680732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:31.690306 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98378536-5f0a-43bd-b453-e011f9032266 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:31.694740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:31.696137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.696416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.696688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] PATH_INFO: `/v3/users/6483f1d17ca749fc855f29fd3aa66984` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.697878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] RBAC: Authorizing `identity:get_user(user_id=6483f1d17ca749fc855f29fd3aa66984)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:31.700199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:31.701743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 544/1101] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:31 2022] GET /identity/v3/users/6483f1d17ca749fc855f29fd3aa66984 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:31.707235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:31.717197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c3983-b241-4a6b-b894-935b1594548b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:31.721744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:31.722364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.722649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.722957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.730485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:31.732244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:31.740842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 558/1102] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:31.746473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:31.755821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605f2f2-cfa0-42fb-af55-4fc4f6d2cab2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:31.760892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9554a6e-c4f3-4559-9aed-3d9b25c7face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:31.761699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9554a6e-c4f3-4559-9aed-3d9b25c7face admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.761981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9554a6e-c4f3-4559-9aed-3d9b25c7face admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.762251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9554a6e-c4f3-4559-9aed-3d9b25c7face admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.763490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9554a6e-c4f3-4559-9aed-3d9b25c7face admin admin] RBAC: Authorizing `identity:get_project(project_id=53ff7a4f23bb449b8a34d21b44349a85)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:31.765480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9554a6e-c4f3-4559-9aed-3d9b25c7face admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:31.767107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 545/1103] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:31 2022] GET /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:31.772837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:31.782243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacae90-3d5b-4c32-a405-ce81d6fff363 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:31.786648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28be81-9734-4faa-b446-54fada9eef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:31.787300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28be81-9734-4faa-b446-54fada9eef1f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:31.787579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28be81-9734-4faa-b446-54fada9eef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:31.787909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28be81-9734-4faa-b446-54fada9eef1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:31.788669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28be81-9734-4faa-b446-54fada9eef1f admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=53ff7a4f23bb449b8a34d21b44349a85, user.id=6483f1d17ca749fc855f29fd3aa66984) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:31.789129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28be81-9734-4faa-b446-54fada9eef1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:31.790941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28be81-9734-4faa-b446-54fada9eef1f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:31.796454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 559/1104] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:31 2022] GET /identity/v3/role_assignments?user.id=6483f1d17ca749fc855f29fd3aa66984&scope.project.id=53ff7a4f23bb449b8a34d21b44349a85&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:33.981139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed11ebf-087e-4b17-a8c5-53736dd63246 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:33.982620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed11ebf-087e-4b17-a8c5-53736dd63246 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:33.982620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed11ebf-087e-4b17-a8c5-53736dd63246 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:33.983555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 546/1105] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:33.988777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e5d29-4f8d-4b75-acea-a084c160bc4f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:33.989187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e5d29-4f8d-4b75-acea-a084c160bc4f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:33.989321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e5d29-4f8d-4b75-acea-a084c160bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:34.007880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-994e5d29-4f8d-4b75-acea-a084c160bc4f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:34.009043 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-994e5d29-4f8d-4b75-acea-a084c160bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:34.016696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 560/1106] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:34.043130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed11ebf-087e-4b17-a8c5-53736dd63246 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:34.055017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed11ebf-087e-4b17-a8c5-53736dd63246 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:34.059293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1831d6-a9ac-4e65-a4ff-dc1672780f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:34.060053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1831d6-a9ac-4e65-a4ff-dc1672780f6a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:34.060335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1831d6-a9ac-4e65-a4ff-dc1672780f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:34.060607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1831d6-a9ac-4e65-a4ff-dc1672780f6a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:34.061751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1831d6-a9ac-4e65-a4ff-dc1672780f6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:34.063482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1831d6-a9ac-4e65-a4ff-dc1672780f6a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:34.065013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 547/1107] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:34.070268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e5d29-4f8d-4b75-acea-a084c160bc4f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:34.079143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e5d29-4f8d-4b75-acea-a084c160bc4f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:34.083782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766b862-ac35-4080-aada-cc6a3600b390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:34.084428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766b862-ac35-4080-aada-cc6a3600b390 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:34.084712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766b862-ac35-4080-aada-cc6a3600b390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:34.084986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766b862-ac35-4080-aada-cc6a3600b390 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:34.086215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766b862-ac35-4080-aada-cc6a3600b390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:34.088116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766b862-ac35-4080-aada-cc6a3600b390 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:34.249900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 561/1108] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:35:34 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:36.481996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fe13d-256c-4d50-8ca8-de16cea2b495 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:36.482535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fe13d-256c-4d50-8ca8-de16cea2b495 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:36.482535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fe13d-256c-4d50-8ca8-de16cea2b495 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:36.484305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 548/1109] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:36.489646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78435b6-ac0a-4c5d-8500-1c6a65341aaf None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:36.490045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78435b6-ac0a-4c5d-8500-1c6a65341aaf None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:36.490195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78435b6-ac0a-4c5d-8500-1c6a65341aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:36.508935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e78435b6-ac0a-4c5d-8500-1c6a65341aaf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:36.510144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e78435b6-ac0a-4c5d-8500-1c6a65341aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:36.518018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 562/1110] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:36.542277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fe13d-256c-4d50-8ca8-de16cea2b495 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:36.554801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fe13d-256c-4d50-8ca8-de16cea2b495 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:36.559427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:36.562244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:36.562244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:36.562244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] PATH_INFO: `/v3/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:36.562244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] RBAC: Authorizing `identity:get_role(role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:36.563287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:35:36.563287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:35:36.563287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:35:36.564152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:36.565485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 549/1111] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:36 2022] GET /identity/v3/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:36.571447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78435b6-ac0a-4c5d-8500-1c6a65341aaf None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:36.580205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78435b6-ac0a-4c5d-8500-1c6a65341aaf None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:36.585277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:36.586117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:36.586402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:36.586676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] PATH_INFO: `/v3/users/d5b68ce520e24e52964c06771c998151` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:36.599696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] RBAC: Authorizing `identity:get_user(user_id=d5b68ce520e24e52964c06771c998151)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:36.602412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:36.604063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 563/1112] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:36 2022] GET /identity/v3/users/d5b68ce520e24e52964c06771c998151 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:36.609685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:36.619634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0b914-6a48-48a8-9b9c-ec61d1cd2221 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:36.624058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:36.624678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:36.624959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:36.625232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:36.633310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:36.635050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:36.643572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 550/1113] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:36.649002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:36.658566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a24def-13a9-4948-9e99-54f1f9366819 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:36.663090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06cb34-7bf0-4921-9bb4-3ed7a6d10ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:36.664450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06cb34-7bf0-4921-9bb4-3ed7a6d10ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:36.664728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06cb34-7bf0-4921-9bb4-3ed7a6d10ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:36.665004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06cb34-7bf0-4921-9bb4-3ed7a6d10ac2 admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:36.666176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06cb34-7bf0-4921-9bb4-3ed7a6d10ac2 admin admin] RBAC: Authorizing `identity:get_project(project_id=53ff7a4f23bb449b8a34d21b44349a85)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:36.668487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06cb34-7bf0-4921-9bb4-3ed7a6d10ac2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:36.670025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 564/1114] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:36 2022] GET /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:36.677051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:36.686667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3570-4b3a-4f51-a670-fb4d1aa15423 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:36.691148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c519e4c-95d7-4c2a-a267-30b4df01ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:36.691772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519e4c-95d7-4c2a-a267-30b4df01ad4c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:36.692048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519e4c-95d7-4c2a-a267-30b4df01ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:36.692315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519e4c-95d7-4c2a-a267-30b4df01ad4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:36.693135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c519e4c-95d7-4c2a-a267-30b4df01ad4c admin admin] RBAC: Adding query filter params (role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=53ff7a4f23bb449b8a34d21b44349a85, user.id=d5b68ce520e24e52964c06771c998151) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:36.693438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c519e4c-95d7-4c2a-a267-30b4df01ad4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:36.695279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c519e4c-95d7-4c2a-a267-30b4df01ad4c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:36.700347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 551/1115] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:36 2022] GET /identity/v3/role_assignments?user.id=d5b68ce520e24e52964c06771c998151&scope.project.id=53ff7a4f23bb449b8a34d21b44349a85&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:38.831710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70153f-f229-4e5f-b740-d7fcb103c81b None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:38.832236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70153f-f229-4e5f-b740-d7fcb103c81b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:38.832236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70153f-f229-4e5f-b740-d7fcb103c81b None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:38.834009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 565/1116] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:38.839301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0290-dd55-4b3a-88a0-1dae1ad522a6 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:38.839735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0290-dd55-4b3a-88a0-1dae1ad522a6 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:38.839852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0290-dd55-4b3a-88a0-1dae1ad522a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:38.857076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-a04d0290-dd55-4b3a-88a0-1dae1ad522a6 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:38.858251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a04d0290-dd55-4b3a-88a0-1dae1ad522a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:38.865831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 552/1117] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:38.889480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70153f-f229-4e5f-b740-d7fcb103c81b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:38.901335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70153f-f229-4e5f-b740-d7fcb103c81b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:38.906058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:38.906927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:38.907231 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:38.907504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] PATH_INFO: `/v3/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:38.908969 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] RBAC: Authorizing `identity:get_role(role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:38.909983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:35:38.909983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:35:38.909983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:35:38.910909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:38.912211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 566/1118] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:38 2022] GET /identity/v3/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:38.918065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d0290-dd55-4b3a-88a0-1dae1ad522a6 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:38.926699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d0290-dd55-4b3a-88a0-1dae1ad522a6 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:38.931715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:38.932552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:38.932827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:38.933095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] PATH_INFO: `/v3/users/d5b68ce520e24e52964c06771c998151` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:38.934279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] RBAC: Authorizing `identity:get_user(user_id=d5b68ce520e24e52964c06771c998151)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:38.937347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:38.938904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 553/1119] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:38 2022] GET /identity/v3/users/d5b68ce520e24e52964c06771c998151 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:38.944213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:38.953550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce047-ff7c-4610-a622-b7c409f1ba1b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:38.957998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d6d29-7aaf-4a3c-8ea4-0139bfd76b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:38.958842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d6d29-7aaf-4a3c-8ea4-0139bfd76b75 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:38.959123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d6d29-7aaf-4a3c-8ea4-0139bfd76b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:38.959394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d6d29-7aaf-4a3c-8ea4-0139bfd76b75 admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:38.960548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d6d29-7aaf-4a3c-8ea4-0139bfd76b75 admin admin] RBAC: Authorizing `identity:get_project(project_id=53ff7a4f23bb449b8a34d21b44349a85)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:38.962541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d6d29-7aaf-4a3c-8ea4-0139bfd76b75 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:38.964193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 567/1120] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:38 2022] GET /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:38.969447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:38.979020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625ac23-231b-49ca-8421-3aa7081c9dea admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:38.983402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8911f-ffa0-435e-884b-dfe8e8e5106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:38.984234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8911f-ffa0-435e-884b-dfe8e8e5106a admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:38.984512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8911f-ffa0-435e-884b-dfe8e8e5106a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:38.984784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8911f-ffa0-435e-884b-dfe8e8e5106a admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85/users/d5b68ce520e24e52964c06771c998151/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:38.986968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8911f-ffa0-435e-884b-dfe8e8e5106a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ff7a4f23bb449b8a34d21b44349a85, user_id=d5b68ce520e24e52964c06771c998151, role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:38.989528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8911f-ffa0-435e-884b-dfe8e8e5106a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:39.061326 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 554/1121] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:35:38 2022] PUT /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85/users/d5b68ce520e24e52964c06771c998151/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:35:41.222267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec5d2-4dd2-41bb-8131-e166e96f8076 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:41.222827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec5d2-4dd2-41bb-8131-e166e96f8076 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:41.222827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ec5d2-4dd2-41bb-8131-e166e96f8076 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:41.224608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 568/1122] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:41.229731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccdb13-ad16-405d-b08d-b146eb7620dd None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:41.230103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccdb13-ad16-405d-b08d-b146eb7620dd None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:41.230283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccdb13-ad16-405d-b08d-b146eb7620dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:41.247565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8eccdb13-ad16-405d-b08d-b146eb7620dd None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:41.248734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8eccdb13-ad16-405d-b08d-b146eb7620dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:41.317478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 555/1123] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:41.342378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec5d2-4dd2-41bb-8131-e166e96f8076 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:41.354435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ec5d2-4dd2-41bb-8131-e166e96f8076 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:41.358897 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:41.359728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:41.360008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:41.360277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] PATH_INFO: `/v3/roles/e94e3d8f94494e0a8a257c8978ebb33e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:41.361751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] RBAC: Authorizing `identity:get_role(role_id=e94e3d8f94494e0a8a257c8978ebb33e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:41.363379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:41.364736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 569/1124] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:41 2022] GET /identity/v3/roles/e94e3d8f94494e0a8a257c8978ebb33e => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:41.370459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccdb13-ad16-405d-b08d-b146eb7620dd None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:41.379250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccdb13-ad16-405d-b08d-b146eb7620dd None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:41.384199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:41.385044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:41.385317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:41.385581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] PATH_INFO: `/v3/users/d5b68ce520e24e52964c06771c998151` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:41.386808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] RBAC: Authorizing `identity:get_user(user_id=d5b68ce520e24e52964c06771c998151)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:41.388893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:41.390437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 556/1125] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:41 2022] GET /identity/v3/users/d5b68ce520e24e52964c06771c998151 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:41.395973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:41.406397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0bbb6-4a1b-495c-892f-eddcdca958f4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:41.410932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:41.411554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:41.411836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:41.412111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:41.419733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:41.421451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:41.430068 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 570/1126] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:41 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:41.435587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:41.445337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687e84-6c53-428b-987c-45e14ba63486 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:41.449859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfeca3-ceb1-4086-add4-bdb463ca4a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:41.450668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfeca3-ceb1-4086-add4-bdb463ca4a85 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:41.450975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfeca3-ceb1-4086-add4-bdb463ca4a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:41.451244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfeca3-ceb1-4086-add4-bdb463ca4a85 admin admin] PATH_INFO: `/v3/projects/53ff7a4f23bb449b8a34d21b44349a85` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:41.452400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfeca3-ceb1-4086-add4-bdb463ca4a85 admin admin] RBAC: Authorizing `identity:get_project(project_id=53ff7a4f23bb449b8a34d21b44349a85)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:41.454386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfeca3-ceb1-4086-add4-bdb463ca4a85 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:41.456024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 557/1127] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:41 2022] GET /identity/v3/projects/53ff7a4f23bb449b8a34d21b44349a85 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:35:41.462137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:41.470543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc09cc-baec-4eeb-bf0e-c41448f59757 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:41.475054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef709e49-2b3f-41ff-a7bd-60866791132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:41.475616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef709e49-2b3f-41ff-a7bd-60866791132d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:41.475907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef709e49-2b3f-41ff-a7bd-60866791132d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:41.476178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef709e49-2b3f-41ff-a7bd-60866791132d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:41.476993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef709e49-2b3f-41ff-a7bd-60866791132d admin admin] RBAC: Adding query filter params (role.id=e94e3d8f94494e0a8a257c8978ebb33e, scope.project.id=53ff7a4f23bb449b8a34d21b44349a85, user.id=d5b68ce520e24e52964c06771c998151) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:41.477296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef709e49-2b3f-41ff-a7bd-60866791132d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:41.479144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef709e49-2b3f-41ff-a7bd-60866791132d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:41.484597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 571/1128] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:41 2022] GET /identity/v3/role_assignments?user.id=d5b68ce520e24e52964c06771c998151&scope.project.id=53ff7a4f23bb449b8a34d21b44349a85&role.id=e94e3d8f94494e0a8a257c8978ebb33e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:43.698080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf560eb4-4f0e-4c3d-8271-5a3e82b6e6c0 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:43.698620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf560eb4-4f0e-4c3d-8271-5a3e82b6e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:43.698620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf560eb4-4f0e-4c3d-8271-5a3e82b6e6c0 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:43.700419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 558/1129] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:43.705567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a98502-0be1-44b8-b77b-47501cccef57 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:43.705971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a98502-0be1-44b8-b77b-47501cccef57 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:43.706118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a98502-0be1-44b8-b77b-47501cccef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:43.723928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-03a98502-0be1-44b8-b77b-47501cccef57 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:43.725102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-03a98502-0be1-44b8-b77b-47501cccef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:43.732828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 572/1130] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:43.756677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf560eb4-4f0e-4c3d-8271-5a3e82b6e6c0 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:43.769102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf560eb4-4f0e-4c3d-8271-5a3e82b6e6c0 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:43.774187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2503222-8a04-47d7-ae71-1a161173e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:43.774837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2503222-8a04-47d7-ae71-1a161173e0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:43.775121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2503222-8a04-47d7-ae71-1a161173e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:43.775394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2503222-8a04-47d7-ae71-1a161173e0d4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:43.776566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2503222-8a04-47d7-ae71-1a161173e0d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:43.778229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2503222-8a04-47d7-ae71-1a161173e0d4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:43.779815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 559/1131] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:43.785374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a98502-0be1-44b8-b77b-47501cccef57 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:43.794219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a98502-0be1-44b8-b77b-47501cccef57 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:43.798746 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f1df5-cc3d-48d2-8db0-3bf83e87947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:43.799408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f1df5-cc3d-48d2-8db0-3bf83e87947f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:43.799680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f1df5-cc3d-48d2-8db0-3bf83e87947f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:43.800023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f1df5-cc3d-48d2-8db0-3bf83e87947f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:43.800753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f1df5-cc3d-48d2-8db0-3bf83e87947f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:43.802612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f1df5-cc3d-48d2-8db0-3bf83e87947f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:43.918862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 573/1132] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:35:43 2022] POST /identity/v3/projects => generated 311 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:35:46.137570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6119-d8e7-454e-b20d-21bb9e16049f None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:46.138123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6119-d8e7-454e-b20d-21bb9e16049f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:46.138123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6119-d8e7-454e-b20d-21bb9e16049f None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:46.139970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 560/1133] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:46.145226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6cb17-0e84-47b6-a9f5-a30d1e06d4cf None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:46.145645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6cb17-0e84-47b6-a9f5-a30d1e06d4cf None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:46.145779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6cb17-0e84-47b6-a9f5-a30d1e06d4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:46.163645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-00a6cb17-0e84-47b6-a9f5-a30d1e06d4cf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:46.164825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-00a6cb17-0e84-47b6-a9f5-a30d1e06d4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:46.220399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 574/1134] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:46.245719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6119-d8e7-454e-b20d-21bb9e16049f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:46.257480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6119-d8e7-454e-b20d-21bb9e16049f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:46.261798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceedc0b-41f1-4367-bb0d-b3347ab98cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:46.262561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceedc0b-41f1-4367-bb0d-b3347ab98cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:46.262890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceedc0b-41f1-4367-bb0d-b3347ab98cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:46.263147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceedc0b-41f1-4367-bb0d-b3347ab98cd0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:46.264296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceedc0b-41f1-4367-bb0d-b3347ab98cd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:46.265945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceedc0b-41f1-4367-bb0d-b3347ab98cd0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:46.267501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 561/1135] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:35:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:46.273338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6cb17-0e84-47b6-a9f5-a30d1e06d4cf None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:46.282344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6cb17-0e84-47b6-a9f5-a30d1e06d4cf None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:46.286900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a9e1a-0455-4dbd-8cc8-f180194335b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:46.287547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a9e1a-0455-4dbd-8cc8-f180194335b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:46.287830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a9e1a-0455-4dbd-8cc8-f180194335b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:46.288104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a9e1a-0455-4dbd-8cc8-f180194335b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:46.289414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a9e1a-0455-4dbd-8cc8-f180194335b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:46.291395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a9e1a-0455-4dbd-8cc8-f180194335b2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:46.409863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 575/1136] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:35:46 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:35:48.708572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70658bf-df5d-47a0-becb-0f1e8052da98 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.709096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70658bf-df5d-47a0-becb-0f1e8052da98 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.709096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70658bf-df5d-47a0-becb-0f1e8052da98 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.710934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 562/1137] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:48.716129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f24c6-59b8-441e-8f1e-4db27b435cd5 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.716524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f24c6-59b8-441e-8f1e-4db27b435cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.716683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f24c6-59b8-441e-8f1e-4db27b435cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.734403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2e4f24c6-59b8-441e-8f1e-4db27b435cd5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:48.735633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2e4f24c6-59b8-441e-8f1e-4db27b435cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:48.743861 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 576/1138] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:48.767390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70658bf-df5d-47a0-becb-0f1e8052da98 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:48.779205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70658bf-df5d-47a0-becb-0f1e8052da98 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:48.783759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:48.784516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.784795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.785064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.795454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:48.802227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:35:48.803367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 563/1139] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:48.809636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f24c6-59b8-441e-8f1e-4db27b435cd5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:48.818356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f24c6-59b8-441e-8f1e-4db27b435cd5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:48.824981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:48.825622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.825957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.826289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.827115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:48.827422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:48.829012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:48.837271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 577/1140] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:48.842933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:48.853417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f92e2-4289-48bb-b235-d5f9a9e67352 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:48.857989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:48.858858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.859144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.859418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] PATH_INFO: `/v3/users/8281bf07295f4cb6ac2255c841147e1e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.872646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=8281bf07295f4cb6ac2255c841147e1e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:48.874768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:48.876355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 564/1141] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:48 2022] GET /identity/v3/users/8281bf07295f4cb6ac2255c841147e1e => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:48.881775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:48.891138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c07a9-da41-4fd0-ac31-83cebf97ead7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:48.895564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:48.896183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.896459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.896730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.904288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:48.906277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:48.915243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 578/1142] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:48.920910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:48.930790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5369984-e369-49f2-906d-fac869fef8e8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:48.935274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9744aa-fb68-4665-a142-453ded73653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:48.936097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9744aa-fb68-4665-a142-453ded73653a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.936381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9744aa-fb68-4665-a142-453ded73653a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.936654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9744aa-fb68-4665-a142-453ded73653a admin admin] PATH_INFO: `/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.937850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9744aa-fb68-4665-a142-453ded73653a admin admin] RBAC: Authorizing `identity:get_project(project_id=364a8f37a9d1462e8b60c7e04b5c421a)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:48.939912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9744aa-fb68-4665-a142-453ded73653a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:48.941649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 565/1143] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:48 2022] GET /identity/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:48.947137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:48.955661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59fc7d-2c37-4fc8-8a67-04528893f68d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:48.960183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603365ad-0c24-4e98-be12-d6ec79a1be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:48.960747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603365ad-0c24-4e98-be12-d6ec79a1be71 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:48.961027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603365ad-0c24-4e98-be12-d6ec79a1be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:48.961300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603365ad-0c24-4e98-be12-d6ec79a1be71 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:48.962123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603365ad-0c24-4e98-be12-d6ec79a1be71 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=364a8f37a9d1462e8b60c7e04b5c421a, user.id=8281bf07295f4cb6ac2255c841147e1e) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:48.962432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603365ad-0c24-4e98-be12-d6ec79a1be71 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:48.964277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603365ad-0c24-4e98-be12-d6ec79a1be71 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:48.969456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 579/1144] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:48 2022] GET /identity/v3/role_assignments?user.id=8281bf07295f4cb6ac2255c841147e1e&scope.project.id=364a8f37a9d1462e8b60c7e04b5c421a&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:51.127069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01d1e-aac2-4c9e-9415-3c8254e72673 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:51.127644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01d1e-aac2-4c9e-9415-3c8254e72673 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:51.127644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01d1e-aac2-4c9e-9415-3c8254e72673 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:51.129371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 566/1145] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:51.135012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022def37-d1b9-4e15-b413-65cd68c8244a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:51.135415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022def37-d1b9-4e15-b413-65cd68c8244a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:51.135561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022def37-d1b9-4e15-b413-65cd68c8244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:51.153250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-022def37-d1b9-4e15-b413-65cd68c8244a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:51.154412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-022def37-d1b9-4e15-b413-65cd68c8244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:51.162126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 580/1146] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:51.184710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01d1e-aac2-4c9e-9415-3c8254e72673 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:51.197044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01d1e-aac2-4c9e-9415-3c8254e72673 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:51.201396 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:51.202156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:51.202439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:51.202709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:51.213313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:51.219958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:35:51.221084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 567/1147] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:51.226621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022def37-d1b9-4e15-b413-65cd68c8244a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:51.235270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022def37-d1b9-4e15-b413-65cd68c8244a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:51.239649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:51.240320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:51.240594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:51.240862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:51.241606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:51.241907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:51.243517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:51.251397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 581/1148] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:51.257394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:51.268319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dc738-6089-4653-8741-a85b52136134 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:51.273327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:51.274174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:51.274449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:51.274717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] PATH_INFO: `/v3/users/8281bf07295f4cb6ac2255c841147e1e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:51.275932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8281bf07295f4cb6ac2255c841147e1e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:51.278004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:51.279560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 568/1149] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:51 2022] GET /identity/v3/users/8281bf07295f4cb6ac2255c841147e1e => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:51.285202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:51.294652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8337-2f2e-4ab9-84c0-9f87bb1bf3a3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:51.299150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90498e-1e82-468d-8304-2ac1f70cc1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:51.299984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90498e-1e82-468d-8304-2ac1f70cc1fa admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:51.300264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90498e-1e82-468d-8304-2ac1f70cc1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:51.300537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90498e-1e82-468d-8304-2ac1f70cc1fa admin admin] PATH_INFO: `/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:51.301734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90498e-1e82-468d-8304-2ac1f70cc1fa admin admin] RBAC: Authorizing `identity:get_project(project_id=364a8f37a9d1462e8b60c7e04b5c421a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:51.304311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90498e-1e82-468d-8304-2ac1f70cc1fa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:51.305927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 582/1150] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:51 2022] GET /identity/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:51.311272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:51.320979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc74773-1936-4757-b1d5-45b54ed358e6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:51.325383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6a7f1-2922-4919-89bb-046b16be68ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:51.326221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a7f1-2922-4919-89bb-046b16be68ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:51.326493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a7f1-2922-4919-89bb-046b16be68ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:51.326781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a7f1-2922-4919-89bb-046b16be68ec admin admin] PATH_INFO: `/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a/users/8281bf07295f4cb6ac2255c841147e1e/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:51.328689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6a7f1-2922-4919-89bb-046b16be68ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=364a8f37a9d1462e8b60c7e04b5c421a, user_id=8281bf07295f4cb6ac2255c841147e1e, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:51.331287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6a7f1-2922-4919-89bb-046b16be68ec admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:51.450603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 569/1151] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:35:51 2022] PUT /identity/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a/users/8281bf07295f4cb6ac2255c841147e1e/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:35:53.615041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76b12-b60d-4743-88d1-e26d42d8a9b8 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.615593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76b12-b60d-4743-88d1-e26d42d8a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.615593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76b12-b60d-4743-88d1-e26d42d8a9b8 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.617890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 583/1152] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:53.623353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09fa2-54c3-4afd-b203-d420199e44c8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.623748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09fa2-54c3-4afd-b203-d420199e44c8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.623847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09fa2-54c3-4afd-b203-d420199e44c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.641768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dfa09fa2-54c3-4afd-b203-d420199e44c8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:53.643036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dfa09fa2-54c3-4afd-b203-d420199e44c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:53.699169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 570/1153] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:53.723333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76b12-b60d-4743-88d1-e26d42d8a9b8 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:53.735289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76b12-b60d-4743-88d1-e26d42d8a9b8 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:53.739715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:53.740485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.740763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.741559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.751645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:35:53.758994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:35:53.760161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 584/1154] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:53.766313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09fa2-54c3-4afd-b203-d420199e44c8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:53.776329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09fa2-54c3-4afd-b203-d420199e44c8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:53.784054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:53.785098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.785514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.785929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.787189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:53.787662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:53.790402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:53.805368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 571/1155] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:35:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:53.811819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:53.825942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177f61-b7e0-4f67-92f4-183efd630e0d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:53.831302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:53.832165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.832443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.832715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] PATH_INFO: `/v3/users/8281bf07295f4cb6ac2255c841147e1e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.833899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] RBAC: Authorizing `identity:get_user(user_id=8281bf07295f4cb6ac2255c841147e1e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:53.836101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:53.837699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 585/1156] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:35:53 2022] GET /identity/v3/users/8281bf07295f4cb6ac2255c841147e1e => generated 286 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:53.843633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:53.853189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebd1d5-49c5-48a7-b477-287a55018310 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:53.857700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:53.858332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.858615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.858924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.867115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:53.868851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:53.877669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 572/1157] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:53.884305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:53.894122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bf817-8224-4ea7-ae8d-7fa18f254514 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:53.898874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377dfb0-8e00-4d67-a24c-57a23878c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:53.899731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377dfb0-8e00-4d67-a24c-57a23878c565 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.900010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377dfb0-8e00-4d67-a24c-57a23878c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.900279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377dfb0-8e00-4d67-a24c-57a23878c565 admin admin] PATH_INFO: `/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.901468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377dfb0-8e00-4d67-a24c-57a23878c565 admin admin] RBAC: Authorizing `identity:get_project(project_id=364a8f37a9d1462e8b60c7e04b5c421a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:53.903835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377dfb0-8e00-4d67-a24c-57a23878c565 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:53.905641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 586/1158] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:35:53 2022] GET /identity/v3/projects/364a8f37a9d1462e8b60c7e04b5c421a => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:53.911807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:53.921192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7a971-9258-49af-9da5-dd193ce9079e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:53.925795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26719b-6278-445d-82fa-9d1223b572a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:53.926425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26719b-6278-445d-82fa-9d1223b572a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:53.926706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26719b-6278-445d-82fa-9d1223b572a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:53.927013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26719b-6278-445d-82fa-9d1223b572a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:53.927843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26719b-6278-445d-82fa-9d1223b572a2 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=364a8f37a9d1462e8b60c7e04b5c421a, user.id=8281bf07295f4cb6ac2255c841147e1e) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:53.928151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26719b-6278-445d-82fa-9d1223b572a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:53.930612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26719b-6278-445d-82fa-9d1223b572a2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:53.936363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 573/1159] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:35:53 2022] GET /identity/v3/role_assignments?user.id=8281bf07295f4cb6ac2255c841147e1e&scope.project.id=364a8f37a9d1462e8b60c7e04b5c421a&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:56.200344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cccd5-faae-42bc-957e-a1e047457b5b None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:56.200882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cccd5-faae-42bc-957e-a1e047457b5b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:56.200882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cccd5-faae-42bc-957e-a1e047457b5b None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:56.202643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 587/1160] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:35:56.208328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58fd2c-ad03-4b41-9be9-edf7457c063c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:56.208726 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58fd2c-ad03-4b41-9be9-edf7457c063c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:56.208879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58fd2c-ad03-4b41-9be9-edf7457c063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:56.226641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7f58fd2c-ad03-4b41-9be9-edf7457c063c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:56.227841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7f58fd2c-ad03-4b41-9be9-edf7457c063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:56.235803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 574/1161] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:56.259609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cccd5-faae-42bc-957e-a1e047457b5b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:56.271630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cccd5-faae-42bc-957e-a1e047457b5b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:56.276119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:56.276752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:56.277032 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:56.277396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:56.285797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:56.287580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:56.297780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 588/1162] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:35:56 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:35:56.304934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58fd2c-ad03-4b41-9be9-edf7457c063c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:56.314243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58fd2c-ad03-4b41-9be9-edf7457c063c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:56.319222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f75e6f-6fff-45ac-8b76-6b2a065ecb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:56.320014 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75e6f-6fff-45ac-8b76-6b2a065ecb2f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:56.320295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75e6f-6fff-45ac-8b76-6b2a065ecb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:56.320563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75e6f-6fff-45ac-8b76-6b2a065ecb2f admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:56.327367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f75e6f-6fff-45ac-8b76-6b2a065ecb2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:56.329181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f75e6f-6fff-45ac-8b76-6b2a065ecb2f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:56.342510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-b3f75e6f-6fff-45ac-8b76-6b2a065ecb2f admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 17 09:35:56.343690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 575/1163] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:35:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:35:56.349691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:56.359093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e746-9ca3-4ae2-b901-e5dbf4bfa07f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:56.363668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa71d6-d57d-4723-8a3b-8eba8e90c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:56.364300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa71d6-d57d-4723-8a3b-8eba8e90c85e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:56.364584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa71d6-d57d-4723-8a3b-8eba8e90c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:56.364863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa71d6-d57d-4723-8a3b-8eba8e90c85e admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:56.365593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa71d6-d57d-4723-8a3b-8eba8e90c85e admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:35:56.365895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa71d6-d57d-4723-8a3b-8eba8e90c85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:56.368118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa71d6-d57d-4723-8a3b-8eba8e90c85e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:56.375417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 589/1164] 10.222.0.88 () {56 vars in 1136 bytes} [Mon Jan 17 09:35:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:35:58.591393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff56906-04b1-484e-812f-9d6e0dab5dd8 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:58.591914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff56906-04b1-484e-812f-9d6e0dab5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:58.591914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff56906-04b1-484e-812f-9d6e0dab5dd8 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:58.593711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 576/1165] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:35:58.599164 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef96432-b8c6-4a8e-b9aa-95980ed610ff None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:58.599623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef96432-b8c6-4a8e-b9aa-95980ed610ff None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:58.599715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef96432-b8c6-4a8e-b9aa-95980ed610ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:58.617194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6ef96432-b8c6-4a8e-b9aa-95980ed610ff None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:35:58.618384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6ef96432-b8c6-4a8e-b9aa-95980ed610ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:35:58.626540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 590/1166] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:35:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:35:58.651283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff56906-04b1-484e-812f-9d6e0dab5dd8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:35:58.666354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff56906-04b1-484e-812f-9d6e0dab5dd8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:35:58.670773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde821b-8baf-486b-b625-57b9ea515295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:35:58.671446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde821b-8baf-486b-b625-57b9ea515295 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:35:58.671726 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde821b-8baf-486b-b625-57b9ea515295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:35:58.671997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde821b-8baf-486b-b625-57b9ea515295 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:35:58.672758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde821b-8baf-486b-b625-57b9ea515295 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:35:58.673781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-cbde821b-8baf-486b-b625-57b9ea515295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:35:58.673781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:35:58.673781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:35:58.674656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde821b-8baf-486b-b625-57b9ea515295 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:35:58.816757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 577/1167] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jan 17 09:35:58 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:36:01.089749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5d7c9-e49e-4ca0-ae3c-078a9054a15b None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:01.090338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5d7c9-e49e-4ca0-ae3c-078a9054a15b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:01.090338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5d7c9-e49e-4ca0-ae3c-078a9054a15b None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:01.092076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 591/1168] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:36:01.097254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ec161-7cfc-40c1-bd99-8c992cba3cb9 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:01.097716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ec161-7cfc-40c1-bd99-8c992cba3cb9 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:01.097816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ec161-7cfc-40c1-bd99-8c992cba3cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:01.118255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-523ec161-7cfc-40c1-bd99-8c992cba3cb9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:36:01.119480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-523ec161-7cfc-40c1-bd99-8c992cba3cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:36:01.176000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 578/1169] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:36:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:36:01.200593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5d7c9-e49e-4ca0-ae3c-078a9054a15b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:01.212781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5d7c9-e49e-4ca0-ae3c-078a9054a15b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:01.217259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4792337-793e-4e26-8f30-feb2531cb9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:01.218090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792337-793e-4e26-8f30-feb2531cb9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:01.218368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792337-793e-4e26-8f30-feb2531cb9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:01.218648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792337-793e-4e26-8f30-feb2531cb9d3 admin admin] PATH_INFO: `/v3/domains/74f68ee7915b47cba423d9f00fc141e9` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:01.228884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4792337-793e-4e26-8f30-feb2531cb9d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=74f68ee7915b47cba423d9f00fc141e9)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:01.230847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4792337-793e-4e26-8f30-feb2531cb9d3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:01.232440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 592/1170] 10.222.0.88 () {56 vars in 1204 bytes} [Mon Jan 17 09:36:01 2022] GET /identity/v3/domains/74f68ee7915b47cba423d9f00fc141e9 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:01.238196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ec161-7cfc-40c1-bd99-8c992cba3cb9 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:01.248023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ec161-7cfc-40c1-bd99-8c992cba3cb9 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:01.252526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eff8d1-3594-4fa8-b40d-7a883e1a5129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:01.253177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eff8d1-3594-4fa8-b40d-7a883e1a5129 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:01.253466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eff8d1-3594-4fa8-b40d-7a883e1a5129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:01.253760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eff8d1-3594-4fa8-b40d-7a883e1a5129 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:01.254463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eff8d1-3594-4fa8-b40d-7a883e1a5129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:01.256396 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eff8d1-3594-4fa8-b40d-7a883e1a5129 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:01.413143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 579/1171] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:36:01 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:36:03.628874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a2d7-d16e-4fa0-b111-ba2c0c8f847b None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:03.629391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a2d7-d16e-4fa0-b111-ba2c0c8f847b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:03.629391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a2d7-d16e-4fa0-b111-ba2c0c8f847b None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:03.631118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 593/1172] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:36:03.636839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711398e-903c-4baa-bcd1-55a48b44f04a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:03.637239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711398e-903c-4baa-bcd1-55a48b44f04a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:03.637393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711398e-903c-4baa-bcd1-55a48b44f04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:03.655486 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8711398e-903c-4baa-bcd1-55a48b44f04a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:36:03.656758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8711398e-903c-4baa-bcd1-55a48b44f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:36:03.712886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 580/1173] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:36:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:36:03.738411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a2d7-d16e-4fa0-b111-ba2c0c8f847b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:03.751313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a2d7-d16e-4fa0-b111-ba2c0c8f847b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:03.755788 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23b823-eb2c-4bbd-8d40-6a59e922784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:03.756629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b823-eb2c-4bbd-8d40-6a59e922784c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:03.756910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b823-eb2c-4bbd-8d40-6a59e922784c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:03.757183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b823-eb2c-4bbd-8d40-6a59e922784c admin admin] PATH_INFO: `/v3/domains/74f68ee7915b47cba423d9f00fc141e9` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:03.758355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23b823-eb2c-4bbd-8d40-6a59e922784c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=74f68ee7915b47cba423d9f00fc141e9)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:03.760333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23b823-eb2c-4bbd-8d40-6a59e922784c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:03.761920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 594/1174] 10.222.0.88 () {56 vars in 1204 bytes} [Mon Jan 17 09:36:03 2022] GET /identity/v3/domains/74f68ee7915b47cba423d9f00fc141e9 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:03.767606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711398e-903c-4baa-bcd1-55a48b44f04a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:03.776320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711398e-903c-4baa-bcd1-55a48b44f04a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:03.780975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f743b-43a0-49aa-9233-7e2509b5dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:03.781618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f743b-43a0-49aa-9233-7e2509b5dd91 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:03.781923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f743b-43a0-49aa-9233-7e2509b5dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:03.782193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f743b-43a0-49aa-9233-7e2509b5dd91 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:03.782945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f743b-43a0-49aa-9233-7e2509b5dd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:03.784819 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f743b-43a0-49aa-9233-7e2509b5dd91 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:03.895383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 581/1175] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:36:03 2022] POST /identity/v3/users => generated 311 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:36:06.163201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9aba3-e339-4142-8901-671d1f9acc1d None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.164049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9aba3-e339-4142-8901-671d1f9acc1d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.164049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9aba3-e339-4142-8901-671d1f9acc1d None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.165750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 595/1176] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:36:06.172533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef180f-19f8-4b24-9e1d-e90e93aebf2f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.173075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef180f-19f8-4b24-9e1d-e90e93aebf2f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.173370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef180f-19f8-4b24-9e1d-e90e93aebf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.199072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-86ef180f-19f8-4b24-9e1d-e90e93aebf2f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:36:06.200786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-86ef180f-19f8-4b24-9e1d-e90e93aebf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:36:06.212443 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 582/1177] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:36:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:36:06.247248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9aba3-e339-4142-8901-671d1f9acc1d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:06.262443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9aba3-e339-4142-8901-671d1f9acc1d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:06.269635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:06.270961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.271449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.272589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.287551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:36:06.298484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:36:06.300407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 596/1178] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:36:06.308530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef180f-19f8-4b24-9e1d-e90e93aebf2f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:06.317885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef180f-19f8-4b24-9e1d-e90e93aebf2f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:06.323018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:06.323681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.323961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.324233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.324994 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:36:06.325298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:06.326913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:06.335255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 583/1179] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:36:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:06.341226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:06.351047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c33a74-0802-4859-8798-7ac647ef9a5b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:06.360313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:06.361174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.361451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.361719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] PATH_INFO: `/v3/users/fec6cbe9ecc5475b9d3f37285c0fb341` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.377903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=fec6cbe9ecc5475b9d3f37285c0fb341)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:06.380087 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:06.382417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 597/1180] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:36:06 2022] GET /identity/v3/users/fec6cbe9ecc5475b9d3f37285c0fb341 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:36:06.388417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:06.398492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41dc15-781f-4f89-a9bc-5bf7f044f065 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:06.403011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:06.403640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.403922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.404195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.412353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:06.414698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:06.423601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 584/1181] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:36:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:36:06.430084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:06.439727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb714e-0c10-4581-b7dc-b248d075e0a0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:06.444419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1523ae-45cd-49ee-ab97-7351fb051948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:06.445458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1523ae-45cd-49ee-ab97-7351fb051948 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.445577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1523ae-45cd-49ee-ab97-7351fb051948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.445800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1523ae-45cd-49ee-ab97-7351fb051948 admin admin] PATH_INFO: `/v3/projects/045c25d6b5424f1287dece8d5b23006e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.447014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1523ae-45cd-49ee-ab97-7351fb051948 admin admin] RBAC: Authorizing `identity:get_project(project_id=045c25d6b5424f1287dece8d5b23006e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:06.449038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1523ae-45cd-49ee-ab97-7351fb051948 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:06.450682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 598/1182] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:36:06 2022] GET /identity/v3/projects/045c25d6b5424f1287dece8d5b23006e => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:06.456880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:06.466122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9d3c5-6bcb-4b25-be58-255593b0ceb4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:06.470867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf981c-e249-43e7-b579-ca58046e94e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:06.471502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf981c-e249-43e7-b579-ca58046e94e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:06.471803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf981c-e249-43e7-b579-ca58046e94e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:06.472073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf981c-e249-43e7-b579-ca58046e94e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:06.472911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf981c-e249-43e7-b579-ca58046e94e8 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=045c25d6b5424f1287dece8d5b23006e, user.id=fec6cbe9ecc5475b9d3f37285c0fb341) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:36:06.473219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf981c-e249-43e7-b579-ca58046e94e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:06.475723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf981c-e249-43e7-b579-ca58046e94e8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:06.481382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 585/1183] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:36:06 2022] GET /identity/v3/role_assignments?user.id=fec6cbe9ecc5475b9d3f37285c0fb341&scope.project.id=045c25d6b5424f1287dece8d5b23006e&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:08.708092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08837aef-f580-4fe2-bacc-452fcd8bdcd7 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:08.708637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08837aef-f580-4fe2-bacc-452fcd8bdcd7 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:08.708637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08837aef-f580-4fe2-bacc-452fcd8bdcd7 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:08.710928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 599/1184] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:36:08.716318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917aa3-7bb6-47ff-9594-95905096dbff None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:08.716857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917aa3-7bb6-47ff-9594-95905096dbff None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:08.716857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917aa3-7bb6-47ff-9594-95905096dbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:08.735354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-11917aa3-7bb6-47ff-9594-95905096dbff None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:36:08.736556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-11917aa3-7bb6-47ff-9594-95905096dbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:36:08.744261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 586/1185] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:36:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:36:08.767510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08837aef-f580-4fe2-bacc-452fcd8bdcd7 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:08.780905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08837aef-f580-4fe2-bacc-452fcd8bdcd7 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:08.785377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:08.786168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:08.786447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:08.786744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:08.798146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:36:08.805048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:36:08.806271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 600/1186] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:36:08.812516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917aa3-7bb6-47ff-9594-95905096dbff None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:08.821619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917aa3-7bb6-47ff-9594-95905096dbff None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:08.826227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:08.826937 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:08.827216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:08.827488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:08.828255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:36:08.828555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:08.830177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:08.839607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 587/1187] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:08.845678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:08.856781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0d11-fb15-4a4d-bf8b-7b43baaedef7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:08.861517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:08.862383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:08.862661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:08.862969 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] PATH_INFO: `/v3/users/fec6cbe9ecc5475b9d3f37285c0fb341` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:08.864195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] RBAC: Authorizing `identity:get_user(user_id=fec6cbe9ecc5475b9d3f37285c0fb341)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:08.866379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:08.868035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 601/1188] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:36:08 2022] GET /identity/v3/users/fec6cbe9ecc5475b9d3f37285c0fb341 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:08.873788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:08.888768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3912f-bf96-47c8-8c5d-ea5a703427fd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:08.893342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93494ee0-1b47-4e0b-a62e-f20c7742fac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:08.894198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93494ee0-1b47-4e0b-a62e-f20c7742fac4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:08.894474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93494ee0-1b47-4e0b-a62e-f20c7742fac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:08.894773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93494ee0-1b47-4e0b-a62e-f20c7742fac4 admin admin] PATH_INFO: `/v3/projects/045c25d6b5424f1287dece8d5b23006e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:08.895941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93494ee0-1b47-4e0b-a62e-f20c7742fac4 admin admin] RBAC: Authorizing `identity:get_project(project_id=045c25d6b5424f1287dece8d5b23006e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:08.898592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93494ee0-1b47-4e0b-a62e-f20c7742fac4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:08.900293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 588/1189] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:36:08 2022] GET /identity/v3/projects/045c25d6b5424f1287dece8d5b23006e => generated 361 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:08.906647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:08.916631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040bbfc-735a-41ac-851e-827faab0950e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:08.923250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855320fb-94aa-4bbc-8910-4e5574b299ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:08.924147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855320fb-94aa-4bbc-8910-4e5574b299ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:08.924428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855320fb-94aa-4bbc-8910-4e5574b299ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:08.924703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855320fb-94aa-4bbc-8910-4e5574b299ef admin admin] PATH_INFO: `/v3/projects/045c25d6b5424f1287dece8d5b23006e/users/fec6cbe9ecc5475b9d3f37285c0fb341/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:08.926716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855320fb-94aa-4bbc-8910-4e5574b299ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=045c25d6b5424f1287dece8d5b23006e, user_id=fec6cbe9ecc5475b9d3f37285c0fb341, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:08.932631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855320fb-94aa-4bbc-8910-4e5574b299ef admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:09.021778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 602/1190] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:36:08 2022] PUT /identity/v3/projects/045c25d6b5424f1287dece8d5b23006e/users/fec6cbe9ecc5475b9d3f37285c0fb341/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:36:11.255453 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a29a-43e0-4138-8188-7427689280a3 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.255989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a29a-43e0-4138-8188-7427689280a3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.256110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a29a-43e0-4138-8188-7427689280a3 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.257839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 589/1191] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:36:11.263376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367f06-d345-4329-8523-22724f9c01bc None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.263846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367f06-d345-4329-8523-22724f9c01bc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.263959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367f06-d345-4329-8523-22724f9c01bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.281954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-bc367f06-d345-4329-8523-22724f9c01bc None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:36:11.283176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-bc367f06-d345-4329-8523-22724f9c01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:36:11.339173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 603/1192] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:36:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:36:11.363753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a29a-43e0-4138-8188-7427689280a3 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:11.377486 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a29a-43e0-4138-8188-7427689280a3 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:11.382484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:11.383294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.383572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.383837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.393750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:36:11.401045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:36:11.402189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 590/1193] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:36:11.408601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc367f06-d345-4329-8523-22724f9c01bc None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:11.418014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc367f06-d345-4329-8523-22724f9c01bc None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:11.423256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:11.423911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.424192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.424463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.425218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:36:11.425521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:11.427128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:11.435994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 604/1194] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:11.441635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:11.451852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98754b2-ab74-49d8-bf0a-f93fce23f4c7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:11.456294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:11.457135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.457416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.457688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] PATH_INFO: `/v3/users/fec6cbe9ecc5475b9d3f37285c0fb341` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.458905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] RBAC: Authorizing `identity:get_user(user_id=fec6cbe9ecc5475b9d3f37285c0fb341)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:11.461006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:11.462563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 591/1195] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Jan 17 09:36:11 2022] GET /identity/v3/users/fec6cbe9ecc5475b9d3f37285c0fb341 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:11.468377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:11.478576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7643ee-11ea-401c-b3c9-07e3d8fcb972 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:11.483224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:11.483860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.484140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.484409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.492697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:11.494494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:11.503116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 605/1196] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:36:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:36:11.509182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:11.518714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025964-e2d3-4770-a213-0b7c4c2ebce5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:11.523893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19c49-a4ab-431f-bd3f-ab9119727a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:11.524732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19c49-a4ab-431f-bd3f-ab9119727a42 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.525011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19c49-a4ab-431f-bd3f-ab9119727a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.525282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19c49-a4ab-431f-bd3f-ab9119727a42 admin admin] PATH_INFO: `/v3/projects/045c25d6b5424f1287dece8d5b23006e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.526450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19c49-a4ab-431f-bd3f-ab9119727a42 admin admin] RBAC: Authorizing `identity:get_project(project_id=045c25d6b5424f1287dece8d5b23006e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:11.528519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19c49-a4ab-431f-bd3f-ab9119727a42 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:11.530417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 592/1197] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:36:11 2022] GET /identity/v3/projects/045c25d6b5424f1287dece8d5b23006e => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:36:11.536572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:36:11.545842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef48ae-307c-4eb8-8047-24cd06e236fa admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:36:11.550459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0b95-0903-4cb8-b99d-736f6003381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:36:11.551128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0b95-0903-4cb8-b99d-736f6003381c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:36:11.551402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0b95-0903-4cb8-b99d-736f6003381c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:36:11.551671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0b95-0903-4cb8-b99d-736f6003381c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:36:11.552499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0b95-0903-4cb8-b99d-736f6003381c admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=045c25d6b5424f1287dece8d5b23006e, user.id=fec6cbe9ecc5475b9d3f37285c0fb341) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:36:11.552801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0b95-0903-4cb8-b99d-736f6003381c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:36:11.554611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0b95-0903-4cb8-b99d-736f6003381c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:36:11.560328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 606/1198] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:36:11 2022] GET /identity/v3/role_assignments?user.id=fec6cbe9ecc5475b9d3f37285c0fb341&scope.project.id=045c25d6b5424f1287dece8d5b23006e&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:37.961586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47890e-decf-4f76-baa1-844e2e0d716b None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:37.962179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47890e-decf-4f76-baa1-844e2e0d716b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:37.962179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47890e-decf-4f76-baa1-844e2e0d716b None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:37.963919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 593/1199] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:37.969314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ed22-42e3-475a-8871-f5c342bdc117 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:37.969776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ed22-42e3-475a-8871-f5c342bdc117 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:37.969872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ed22-42e3-475a-8871-f5c342bdc117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:37.987940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4073ed22-42e3-475a-8871-f5c342bdc117 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:37.989650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4073ed22-42e3-475a-8871-f5c342bdc117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:37.997311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 607/1200] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:38.022885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47890e-decf-4f76-baa1-844e2e0d716b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:38.035561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47890e-decf-4f76-baa1-844e2e0d716b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:38.042438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:38.042438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:38.042438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:38.042438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:38.051151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:38.053500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:38.071509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:38.072709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 594/1201] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:38.078876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073ed22-42e3-475a-8871-f5c342bdc117 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:38.088183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073ed22-42e3-475a-8871-f5c342bdc117 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:38.092735 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d9764-8338-41a7-b2c4-45747cab3ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:38.093380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9764-8338-41a7-b2c4-45747cab3ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:38.093660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9764-8338-41a7-b2c4-45747cab3ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:38.093934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9764-8338-41a7-b2c4-45747cab3ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:38.094664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d9764-8338-41a7-b2c4-45747cab3ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:38.095005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d9764-8338-41a7-b2c4-45747cab3ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:38.096590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d9764-8338-41a7-b2c4-45747cab3ab8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:38.107542 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 608/1202] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:38.113143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:38.123111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98920d06-3722-4b56-8e09-084bdb363f54 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:38.127571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe669209-5aec-41ab-84be-0fd4290c30d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:38.128208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe669209-5aec-41ab-84be-0fd4290c30d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:38.128483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe669209-5aec-41ab-84be-0fd4290c30d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:38.128751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe669209-5aec-41ab-84be-0fd4290c30d4 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:38.129446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe669209-5aec-41ab-84be-0fd4290c30d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:38.132009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe669209-5aec-41ab-84be-0fd4290c30d4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:38.251515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 595/1203] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Jan 17 09:37:38 2022] POST /identity/v3/users => generated 251 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:37:40.501184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18aa3-07cd-4cbb-a8c6-285da3a15739 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.501784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18aa3-07cd-4cbb-a8c6-285da3a15739 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.501916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18aa3-07cd-4cbb-a8c6-285da3a15739 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.503822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 609/1204] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:37:40.510279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08133b-750f-4106-9116-3d2eea59a4f9 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.510765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08133b-750f-4106-9116-3d2eea59a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.510882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08133b-750f-4106-9116-3d2eea59a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.529383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-1a08133b-750f-4106-9116-3d2eea59a4f9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:40.530483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1a08133b-750f-4106-9116-3d2eea59a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:40.538419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 596/1205] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:40.562512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab18aa3-07cd-4cbb-a8c6-285da3a15739 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.576396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab18aa3-07cd-4cbb-a8c6-285da3a15739 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.580778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.581565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.581841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.582114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.593945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:37:40.600911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:37:40.602099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 610/1206] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:40.608260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08133b-750f-4106-9116-3d2eea59a4f9 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.617114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08133b-750f-4106-9116-3d2eea59a4f9 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.621695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.622292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.622570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.622883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.623727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:40.624026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.625602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.634162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 597/1207] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:40.639772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.650157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e44c-69bf-4a21-ad8b-40363960efd0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.655073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.655835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.656120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.656393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.669374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.671286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.688591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:40.690098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 611/1208] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:40.696357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.705897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ab7d5-68de-4fb9-a193-ec5904608f4c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.711145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.711787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.712066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.712342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.713059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:40.713363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.714958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.726656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 598/1209] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:40.732224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.741824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eddc9-c0f5-4fee-aa70-8c9e4717b63d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.746568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.747378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.747661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.747935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.755651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.757653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.771924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 17 09:37:40.773046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 612/1210] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:40.779130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.788766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0477-4c59-4822-b3f9-1930b16aec3d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.793441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.794091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.794371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.794768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.795623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:40.795931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.797774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.815930 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 599/1211] 10.222.0.88 () {56 vars in 1164 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:40.822194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.832021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57892e6-3a3d-4fb2-9232-e971a8955415 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.837113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.837745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.838027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.838301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.845998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.847789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.856568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 613/1212] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:37:40.862137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.872475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245dbad-9b3c-4bf3-b182-cafd2f99828e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.876989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.877761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.878038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.878410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.889285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.891135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.907616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:40.908837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 600/1213] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:40.914690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.923603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7e68-4b2c-4d59-bb21-b92a939b4a57 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.928756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.929396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.929672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.929943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.930660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:40.930989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.932562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.944216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 614/1214] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:40.949922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:40.959664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2b2be-cc80-4b37-9fbe-74113f7d7c8f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:40.964230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:40.965006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:40.965280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:40.965668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:40.972569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:40.974528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:40.987325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:37:40.988448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 601/1215] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:40.994715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:41.004213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873e117-0bc0-4b72-9631-e1bb724eb151 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:41.009583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a5395-1b34-4ccf-b9ec-87111ea87028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:41.010230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a5395-1b34-4ccf-b9ec-87111ea87028 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:41.010511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a5395-1b34-4ccf-b9ec-87111ea87028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:41.010827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a5395-1b34-4ccf-b9ec-87111ea87028 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:41.011625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a5395-1b34-4ccf-b9ec-87111ea87028 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:41.011931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a5395-1b34-4ccf-b9ec-87111ea87028 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:41.013804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a5395-1b34-4ccf-b9ec-87111ea87028 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:41.026223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 615/1216] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:41.032769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:41.043545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6253-8d77-47b9-9cd1-4b1f70de587e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:41.048191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0732256-8774-439e-9ebb-6d8683791f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:41.054485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732256-8774-439e-9ebb-6d8683791f76 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:41.054485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732256-8774-439e-9ebb-6d8683791f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:41.054485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0732256-8774-439e-9ebb-6d8683791f76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:41.054485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732256-8774-439e-9ebb-6d8683791f76 admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=64fd2d1e8d054688a294bcc718449005) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:41.054485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732256-8774-439e-9ebb-6d8683791f76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:41.055061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0732256-8774-439e-9ebb-6d8683791f76 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:41.058656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 602/1217] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:37:41 2022] GET /identity/v3/role_assignments?user.id=64fd2d1e8d054688a294bcc718449005&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:43.335624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff24e6-e646-4a83-806d-4cca8ba6b5df None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.336147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff24e6-e646-4a83-806d-4cca8ba6b5df None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.336234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff24e6-e646-4a83-806d-4cca8ba6b5df None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.337985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 616/1218] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:43.343522 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf882-e21e-45b7-8034-36d9a4671c0f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.343938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf882-e21e-45b7-8034-36d9a4671c0f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.344073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bf882-e21e-45b7-8034-36d9a4671c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.362105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e92bf882-e21e-45b7-8034-36d9a4671c0f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:43.363342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e92bf882-e21e-45b7-8034-36d9a4671c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:43.371092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 603/1219] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:43.393802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff24e6-e646-4a83-806d-4cca8ba6b5df None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.411622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff24e6-e646-4a83-806d-4cca8ba6b5df None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.416180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.416961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.417239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.417510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.428997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:37:43.435879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:37:43.437060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 617/1220] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:43.443922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bf882-e21e-45b7-8034-36d9a4671c0f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.453082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bf882-e21e-45b7-8034-36d9a4671c0f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.457513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.460926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.460926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.460926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.460926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] RBAC: Adding query filter params (name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:43.460926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.462111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.470225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 604/1221] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:43.476221 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.487862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082b762-f493-4676-9243-fa90fddfa14e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.492739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.495327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.495327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.495327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.504287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.506672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.523689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:43.524854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 618/1222] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:43.531177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.540827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee34d26-0849-4a32-80d8-78a001c43e26 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.548473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.548473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.548473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.548473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.548983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:43.548983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.549145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.560531 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 605/1223] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:43.566378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.576586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc6a1b-3c9c-4379-ac90-306eefb3a9df admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.581171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.581973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.582234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.582508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.590754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.592701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.606425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 17 09:37:43.607593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 619/1224] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:43.613512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.623125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9eddb-b76b-4e1f-9bb4-1e8d3dea373c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.627554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.628203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.628481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.628753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.630103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:43.630406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.632276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.649741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 606/1225] 10.222.0.88 () {56 vars in 1164 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:43.655739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.665438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb2ab8-2b7d-4452-85c4-75ec7030fa0c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.670097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.670903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.671185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.671456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.682098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.683963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.701243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:43.702403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 620/1226] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:37:43.708897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.718469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726dbb-7f55-4a50-814d-5a95027dcc70 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.722960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.723638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.723924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.727494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.727494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:43.727494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.727494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.738306 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 607/1227] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:43.744162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.753984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f10a4a-db5f-408c-88ae-9ca3c0a12ff8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.759275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.760049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.760666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.760666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.767547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.769501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.783092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:37:43.784340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 621/1228] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:43.790168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.799919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530dc97-2f9d-4286-86f2-73b51a6016f4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.804852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07aea-36ec-4b69-ad11-e207e4ff17c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.805557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07aea-36ec-4b69-ad11-e207e4ff17c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.805836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07aea-36ec-4b69-ad11-e207e4ff17c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.806109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07aea-36ec-4b69-ad11-e207e4ff17c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.807010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07aea-36ec-4b69-ad11-e207e4ff17c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:43.807321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07aea-36ec-4b69-ad11-e207e4ff17c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.809169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07aea-36ec-4b69-ad11-e207e4ff17c5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:43.822028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 608/1229] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:43.827970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:43.839294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f95ec-8fa5-422b-9493-5db0247d4873 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:43.843807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946577cf-a3da-4b48-9015-46340e234eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:43.844603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946577cf-a3da-4b48-9015-46340e234eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:43.844878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946577cf-a3da-4b48-9015-46340e234eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:43.845143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946577cf-a3da-4b48-9015-46340e234eb6 admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/64fd2d1e8d054688a294bcc718449005/roles/12b074bcc8b34820b03bcf0073c65b0e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:43.858908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946577cf-a3da-4b48-9015-46340e234eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=64fd2d1e8d054688a294bcc718449005, role_id=12b074bcc8b34820b03bcf0073c65b0e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:43.861505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946577cf-a3da-4b48-9015-46340e234eb6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:44.054137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 622/1230] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:37:43 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/64fd2d1e8d054688a294bcc718449005/roles/12b074bcc8b34820b03bcf0073c65b0e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:37:46.331604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896afc2-617b-486b-a2fb-2eb737467589 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.332154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896afc2-617b-486b-a2fb-2eb737467589 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.332154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896afc2-617b-486b-a2fb-2eb737467589 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.334393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 609/1231] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:46.339665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a1dc-7f70-493d-b361-a16f1f55224a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.340096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a1dc-7f70-493d-b361-a16f1f55224a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.340223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a1dc-7f70-493d-b361-a16f1f55224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.358024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6fc9a1dc-7f70-493d-b361-a16f1f55224a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:46.359349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6fc9a1dc-7f70-493d-b361-a16f1f55224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:46.417065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 623/1232] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:46.444323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896afc2-617b-486b-a2fb-2eb737467589 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.456599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896afc2-617b-486b-a2fb-2eb737467589 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.461100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.461873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.462154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.462429 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.472497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:37:46.479917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 17 09:37:46.481059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 610/1233] 10.222.0.88 () {56 vars in 1123 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:46.486999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a1dc-7f70-493d-b361-a16f1f55224a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.496420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a1dc-7f70-493d-b361-a16f1f55224a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.501007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.501659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.501940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.502213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.503004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] RBAC: Adding query filter params (name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:46.503312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.504977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.512925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 624/1234] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:46.518491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.529263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186c8be-f7ce-4f68-9a43-95dcf6eec798 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.533849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.534652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.534985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.535257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.546237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.548081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.565138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:46.566288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 611/1235] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:46.572245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.582496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a888abd-d6fa-4ef4-ae7a-1804b98f91dc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.587047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.587737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.588026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.588296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.589029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:46.589369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.590960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.603397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 625/1236] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:46.608978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.619103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dbb51-d481-42db-97ec-626088935894 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.623612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.624392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.624671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.624942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.632483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.634478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.648310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 17 09:37:46.649484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 612/1237] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:46.655453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.665927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594d6e0-88b7-4aa2-815c-db98bc9a809b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.670482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.671157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.671434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.671700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.672659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:46.672960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.674807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.694148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 626/1238] 10.222.0.88 () {56 vars in 1164 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:46.699637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.709334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c4d1d-f301-488e-a586-9c88abca9449 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.713930 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.714602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.714915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.718245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.722836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.725153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.733946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 613/1239] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:37:46.741338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.750827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b59ac9-b2dd-4894-b0d4-122e3d08d357 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.755324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.756088 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.756364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.756633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.766497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.768392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.784522 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:46.786154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 627/1240] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:46.792443 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.802009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af326f-0c0e-4b54-b7eb-5b3e2b8f0f30 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.807413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.808061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.808336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.808604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.809324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:46.809621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.811231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.822578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 614/1241] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:46.828147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.842269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97a167-0e8d-4702-820e-b17805b49053 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.842902 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.843672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.843951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.844222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.851612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.853569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.866095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:37:46.867246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 628/1242] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:46.872999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.882497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6819-4ecc-4737-ad74-f25e83413457 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.887266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c3f06-8dc4-427c-bf1c-ca4c3ea41f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.887892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3f06-8dc4-427c-bf1c-ca4c3ea41f11 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.888169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3f06-8dc4-427c-bf1c-ca4c3ea41f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.888437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3f06-8dc4-427c-bf1c-ca4c3ea41f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.889218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3f06-8dc4-427c-bf1c-ca4c3ea41f11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:46.889519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3f06-8dc4-427c-bf1c-ca4c3ea41f11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.891361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3f06-8dc4-427c-bf1c-ca4c3ea41f11 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.905731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 615/1243] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:46.912273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:46.922494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b59be3-9d9c-497b-8deb-d1c12d420685 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:46.927151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80da07-c81b-407a-a55c-e1ea722b5ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:46.927774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80da07-c81b-407a-a55c-e1ea722b5ddb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:46.928052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80da07-c81b-407a-a55c-e1ea722b5ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:46.928322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80da07-c81b-407a-a55c-e1ea722b5ddb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:46.929156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80da07-c81b-407a-a55c-e1ea722b5ddb admin admin] RBAC: Adding query filter params (role.id=12b074bcc8b34820b03bcf0073c65b0e, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=64fd2d1e8d054688a294bcc718449005) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:46.929461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80da07-c81b-407a-a55c-e1ea722b5ddb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:46.931335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80da07-c81b-407a-a55c-e1ea722b5ddb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:46.937059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 629/1244] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:37:46 2022] GET /identity/v3/role_assignments?user.id=64fd2d1e8d054688a294bcc718449005&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=12b074bcc8b34820b03bcf0073c65b0e => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:37:49.187982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c896f0-c084-4abd-966f-d0dcf80896eb None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.188535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c896f0-c084-4abd-966f-d0dcf80896eb None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.188659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c896f0-c084-4abd-966f-d0dcf80896eb None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.190489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 616/1245] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:49.196223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9291b-2667-415e-b12d-536ba5907167 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.196648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9291b-2667-415e-b12d-536ba5907167 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.196804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9291b-2667-415e-b12d-536ba5907167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.213823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-45d9291b-2667-415e-b12d-536ba5907167 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:49.215053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-45d9291b-2667-415e-b12d-536ba5907167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:49.222747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 630/1246] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:49.247524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c896f0-c084-4abd-966f-d0dcf80896eb None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.260344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c896f0-c084-4abd-966f-d0dcf80896eb None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.264639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.265399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.265675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.265943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.276020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:37:49.282986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:37:49.284157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 617/1247] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:49.290082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9291b-2667-415e-b12d-536ba5907167 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.298953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9291b-2667-415e-b12d-536ba5907167 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.304768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.305422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.305704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.305976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.306751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:49.307074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.308671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.317793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 631/1248] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:49.323456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.333137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22e1a-9a3b-4d1e-9611-efefea4627be admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.338427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.339256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.339544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.339823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.350760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.352594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.369563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:49.370332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 618/1249] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:49.376237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.386558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c488cc-4203-4e26-bd5f-923e01deec03 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.391066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.391709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.391988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.392265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.392995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:49.393298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.394930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.406794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 632/1250] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:49.412460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.422032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f6f02-963e-482a-9f62-2c6ea964a946 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.427048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.427826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.428106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.428378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.436359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.438403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.451979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 17 09:37:49.453103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 619/1251] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 17 09:37:49.459021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.469632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefddcdf-c753-4624-8bce-fc19e21e873f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.474896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.475559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.475867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.476139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.476987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:49.477294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.479223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.503748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 633/1252] 10.222.0.88 () {56 vars in 1164 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:49.509786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.519457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8689ac-9cbb-4155-802f-997cd0897b97 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.524270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.529600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.529600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.529600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.533394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.535161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.544738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 620/1253] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:37:49.550443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.560943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24facb-ee0d-4253-a40c-3ca773d4aea6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.565562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.566334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.566616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.566922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.577484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.579371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.595870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:49.597025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 634/1254] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:49.603465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.612600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a571-b4ee-41d0-91ab-710d24478b3a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.617963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.618606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.618962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.619241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.619968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:49.620274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.621858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.633764 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 621/1255] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:49.639418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.648938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe5c96-4f01-4368-aeba-90c6b82df664 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.653770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.654541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.654861 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.655138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.662688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.664645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.677879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:37:49.679122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 635/1256] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:49.684955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.694643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec2a75-45ff-493c-af8f-0df1597a2927 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.699170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87172e-31d9-4a80-a2bb-ad5fe63f0380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.699805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87172e-31d9-4a80-a2bb-ad5fe63f0380 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.700081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87172e-31d9-4a80-a2bb-ad5fe63f0380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.700414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87172e-31d9-4a80-a2bb-ad5fe63f0380 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.701452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87172e-31d9-4a80-a2bb-ad5fe63f0380 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:49.701575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87172e-31d9-4a80-a2bb-ad5fe63f0380 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.703431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87172e-31d9-4a80-a2bb-ad5fe63f0380 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.714747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 622/1257] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:49.720594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:49.731636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a583-c883-4925-9f4d-489996458f0e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:49.736090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3236c7e-0d82-4ade-87e1-8ef0b716a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:49.736714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3236c7e-0d82-4ade-87e1-8ef0b716a66d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:49.736995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3236c7e-0d82-4ade-87e1-8ef0b716a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:49.737266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3236c7e-0d82-4ade-87e1-8ef0b716a66d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:49.738095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3236c7e-0d82-4ade-87e1-8ef0b716a66d admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=64fd2d1e8d054688a294bcc718449005) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:49.738405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3236c7e-0d82-4ade-87e1-8ef0b716a66d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:49.740865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3236c7e-0d82-4ade-87e1-8ef0b716a66d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:49.746263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 636/1258] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:37:49 2022] GET /identity/v3/role_assignments?user.id=64fd2d1e8d054688a294bcc718449005&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=c81c29874f234512920b18621694f614 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:51.901011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284eb3-4da4-4a6b-9705-6234bbe33740 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:51.901556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284eb3-4da4-4a6b-9705-6234bbe33740 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:51.901556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284eb3-4da4-4a6b-9705-6234bbe33740 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:51.903585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 623/1259] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:51.908679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d4f2-6a89-4536-b5c6-b4684dd910ff None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:51.909093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d4f2-6a89-4536-b5c6-b4684dd910ff None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:51.909382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d4f2-6a89-4536-b5c6-b4684dd910ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:51.926509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c495d4f2-6a89-4536-b5c6-b4684dd910ff None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:51.927819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c495d4f2-6a89-4536-b5c6-b4684dd910ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:51.935582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 637/1260] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:51.959641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284eb3-4da4-4a6b-9705-6234bbe33740 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:51.971589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284eb3-4da4-4a6b-9705-6234bbe33740 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:51.975889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:51.976650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:51.976929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:51.977198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:51.988842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:37:51.994698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:37:51.995880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 624/1261] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:52.001497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495d4f2-6a89-4536-b5c6-b4684dd910ff None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.010706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495d4f2-6a89-4536-b5c6-b4684dd910ff None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.015158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.015799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.016075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.016344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.035423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:52.035423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.035423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.035423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 638/1262] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:52.035763 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.043377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d354a-8a0f-4f07-b231-fbefd7d27d96 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.047844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.048594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.048868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.049134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.059182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.060976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.078527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:52.079753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 625/1263] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:52.086025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.095519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba278-5cfa-4172-a172-416d564f719f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.101492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.103577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.104072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.104574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.107134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:52.107134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.107593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.120337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 639/1264] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:52.126086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.136251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18fb64-dd7f-49f8-a0c1-58bde3965da3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.140744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.141517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.141820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.142090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.149156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.151225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.165148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 17 09:37:52.166332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 626/1265] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:52.171930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.182027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16e04-f86c-4433-b2be-a7d908af6eb4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.186912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.187624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.187901 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.188173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.189017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:52.189323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.191194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.208738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 640/1266] 10.222.0.88 () {56 vars in 1164 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:52.214438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.224094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3ae9-1b90-4fb1-bf60-964bfe45da64 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.228742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.229599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.229880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.230154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.240738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.242566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.260290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:52.261451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 627/1267] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:52.267146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.277084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe38731-9404-4926-a8d3-42c89abe8ccc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.282029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.282675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.283093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.283371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.284107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:52.284413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.286003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.297191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 641/1268] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:52.303279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.312862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b3818-94a9-42ab-be08-cc28243f63f6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.320955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.320955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.320955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.320955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.326376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.328340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.341349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:37:52.342553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 628/1269] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:52.348361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.358261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba58fb-d4bd-41ce-bad2-7641ce9ef0f7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.363055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473425fe-18c3-4249-b2ac-0594cf72bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.364235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473425fe-18c3-4249-b2ac-0594cf72bcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.364520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473425fe-18c3-4249-b2ac-0594cf72bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.364862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473425fe-18c3-4249-b2ac-0594cf72bcd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.365586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473425fe-18c3-4249-b2ac-0594cf72bcd1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:52.365891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473425fe-18c3-4249-b2ac-0594cf72bcd1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.367770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473425fe-18c3-4249-b2ac-0594cf72bcd1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.380729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 642/1270] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:52.386564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:52.396797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216bc0f-6cc2-4240-b17d-5d9c57d88113 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:52.401180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe123c-d434-427e-b767-3db2f2d20d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:52.402345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe123c-d434-427e-b767-3db2f2d20d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:52.402567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe123c-d434-427e-b767-3db2f2d20d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:52.402864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe123c-d434-427e-b767-3db2f2d20d11 admin admin] PATH_INFO: `/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/64fd2d1e8d054688a294bcc718449005/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:52.405202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe123c-d434-427e-b767-3db2f2d20d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2614964b1c94d9c872f79fedd7d7dbc, user_id=64fd2d1e8d054688a294bcc718449005, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:52.407895 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe123c-d434-427e-b767-3db2f2d20d11 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:52.539847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 629/1271] 10.222.0.88 () {58 vars in 1460 bytes} [Mon Jan 17 09:37:52 2022] PUT /identity/v3/projects/c2614964b1c94d9c872f79fedd7d7dbc/users/64fd2d1e8d054688a294bcc718449005/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:37:54.709454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12144cf4-d883-49ef-965d-f7841debf1c4 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:54.709999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12144cf4-d883-49ef-965d-f7841debf1c4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:54.710107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12144cf4-d883-49ef-965d-f7841debf1c4 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:54.711864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 643/1272] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:54.716918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48423e6-39a3-4fee-baaa-750e07dc170a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:54.717334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48423e6-39a3-4fee-baaa-750e07dc170a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:54.717453 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48423e6-39a3-4fee-baaa-750e07dc170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:54.734565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c48423e6-39a3-4fee-baaa-750e07dc170a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:54.735777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c48423e6-39a3-4fee-baaa-750e07dc170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:54.790754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 630/1273] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:54.815151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12144cf4-d883-49ef-965d-f7841debf1c4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:54.828136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12144cf4-d883-49ef-965d-f7841debf1c4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:54.833062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:54.833825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:54.834108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:54.834413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:54.844767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 17 09:37:54.851532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 17 09:37:54.852689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 644/1274] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Jan 17 09:37:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:54.858583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48423e6-39a3-4fee-baaa-750e07dc170a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:54.867439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48423e6-39a3-4fee-baaa-750e07dc170a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:54.871929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:54.872611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:54.872860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:54.873134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:54.873890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:54.874194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:54.875823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:54.884408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 631/1275] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Jan 17 09:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:54.889812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:54.900402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f50f-a2f9-44ec-8b1b-f5f2d3c7657f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:54.905189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:54.905946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:54.906218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:54.906483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:54.916736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:54.918642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:54.935128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:54.936355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 645/1276] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:54.942758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:54.952203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ea39-4253-483d-9270-2d66ca3e7119 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:54.956632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:54.957822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:54.958087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:54.958367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:54.959119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:54.959426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:54.961049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:54.972466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 632/1277] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:54.978190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:54.987803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd781b-4b3a-47bc-9655-d690fe1ea017 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:54.992339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:54.993161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:54.993442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:54.993711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.000851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.003041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.017366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 17 09:37:55.018486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 646/1278] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:55.024751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:55.034489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343131-4eb1-497e-8412-e3db6d776718 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:55.039182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:55.039829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:55.040102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:55.040373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.041211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:55.041516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.043367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.060301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 633/1279] 10.222.0.88 () {56 vars in 1164 bytes} [Mon Jan 17 09:37:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:37:55.066050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:55.076276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a969-a844-4b23-aaf6-983c8c1065a3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:55.080989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:55.081609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:55.081885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:55.082239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.090771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.092569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.101386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 647/1280] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jan 17 09:37:55 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:37:55.107322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:55.117246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1d32-a9fd-4590-9eed-a6747b7a2d2f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:55.121777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:55.122557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:55.122856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:55.123125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.133934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.135835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.152837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 17 09:37:55.153963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 634/1281] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Jan 17 09:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:55.159662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:55.168439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41741-5f9f-416f-afd6-0cec1198310f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:55.173093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:55.173734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:55.174053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:55.174331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.175103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:55.175412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.177494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.188595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 648/1282] 10.222.0.88 () {56 vars in 1130 bytes} [Mon Jan 17 09:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:55.194691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:55.204248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c6b4-08f1-427d-a5c3-1545891aff91 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:55.209337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:55.210112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:55.210390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:55.214240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.217418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.219402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.232027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING keystone.server.flask.application [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 17 09:37:55.233152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 635/1283] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Jan 17 09:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:55.239490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:55.249320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f990db-e27a-4324-8605-b10ae552330c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:55.253937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcd8bd-1f70-41dd-a64b-3eb7ed5bd6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:55.255233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcd8bd-1f70-41dd-a64b-3eb7ed5bd6fa admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:55.255512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcd8bd-1f70-41dd-a64b-3eb7ed5bd6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:55.255783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcd8bd-1f70-41dd-a64b-3eb7ed5bd6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.256569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcd8bd-1f70-41dd-a64b-3eb7ed5bd6fa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:55.256877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcd8bd-1f70-41dd-a64b-3eb7ed5bd6fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.258705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcd8bd-1f70-41dd-a64b-3eb7ed5bd6fa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.270449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 649/1284] 10.222.0.88 () {56 vars in 1169 bytes} [Mon Jan 17 09:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:55.276410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:55.287111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3d9a-e579-4101-a728-3ae00f415148 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:55.291685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcafbc-31c6-4b76-a87a-99de7d30fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:55.292343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcafbc-31c6-4b76-a87a-99de7d30fe08 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:55.292591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcafbc-31c6-4b76-a87a-99de7d30fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:55.292863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcafbc-31c6-4b76-a87a-99de7d30fe08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:55.293685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcafbc-31c6-4b76-a87a-99de7d30fe08 admin admin] RBAC: Adding query filter params (role.id=c81c29874f234512920b18621694f614, scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc, user.id=64fd2d1e8d054688a294bcc718449005) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:55.293992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcafbc-31c6-4b76-a87a-99de7d30fe08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:55.295868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcafbc-31c6-4b76-a87a-99de7d30fe08 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:55.302366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 636/1285] 10.222.0.88 () {56 vars in 1395 bytes} [Mon Jan 17 09:37:55 2022] GET /identity/v3/role_assignments?user.id=64fd2d1e8d054688a294bcc718449005&scope.project.id=c2614964b1c94d9c872f79fedd7d7dbc&role.id=c81c29874f234512920b18621694f614 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:57.496231 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6a86-ccba-4a5d-972b-1889fc67f854 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:57.496775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6a86-ccba-4a5d-972b-1889fc67f854 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:57.496865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6a86-ccba-4a5d-972b-1889fc67f854 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:57.498597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 650/1286] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:57.503840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b893a-3e33-4b8d-bad9-38d11b8915c9 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:57.504247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b893a-3e33-4b8d-bad9-38d11b8915c9 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:57.504415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b893a-3e33-4b8d-bad9-38d11b8915c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:57.521715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2a0b893a-3e33-4b8d-bad9-38d11b8915c9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:57.529165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2a0b893a-3e33-4b8d-bad9-38d11b8915c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:57.530667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 637/1287] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:57.553510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd6a86-ccba-4a5d-972b-1889fc67f854 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:57.565773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd6a86-ccba-4a5d-972b-1889fc67f854 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:57.571904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:57.572709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:57.573251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:57.573528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:57.574205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:57.575900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:57.592738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 17 09:37:57.593977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 651/1288] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:37:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:37:57.601009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b893a-3e33-4b8d-bad9-38d11b8915c9 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:57.609951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b893a-3e33-4b8d-bad9-38d11b8915c9 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:57.614987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7529c2b-2529-481b-9c76-ddb8322e2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:57.615641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529c2b-2529-481b-9c76-ddb8322e2c3a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:57.615919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529c2b-2529-481b-9c76-ddb8322e2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:57.616184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529c2b-2529-481b-9c76-ddb8322e2c3a admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:57.616921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7529c2b-2529-481b-9c76-ddb8322e2c3a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:57.617234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7529c2b-2529-481b-9c76-ddb8322e2c3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:57.618832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7529c2b-2529-481b-9c76-ddb8322e2c3a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:57.623959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 638/1289] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Jan 17 09:37:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:57.629728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:57.639887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43c14-6c0d-4198-9222-525bab4a7261 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:57.645137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afabf3-8761-42d7-974e-89ca16f947e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:57.645800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afabf3-8761-42d7-974e-89ca16f947e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:57.646080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afabf3-8761-42d7-974e-89ca16f947e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:57.646349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afabf3-8761-42d7-974e-89ca16f947e6 admin admin] PATH_INFO: `/v3/services` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:57.647104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afabf3-8761-42d7-974e-89ca16f947e6 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:37:57.647409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afabf3-8761-42d7-974e-89ca16f947e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:57.649004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afabf3-8761-42d7-974e-89ca16f947e6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:37:57.654079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 652/1290] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Jan 17 09:37:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:37:59.904829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919bf7-dd0d-4365-a307-75c2dd8b7f24 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:59.905387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919bf7-dd0d-4365-a307-75c2dd8b7f24 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:59.905387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919bf7-dd0d-4365-a307-75c2dd8b7f24 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:59.907179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 639/1291] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:37:59.912558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca4f3-8fcf-46a8-b509-4f8f0b794576 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:59.912977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca4f3-8fcf-46a8-b509-4f8f0b794576 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:59.914450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca4f3-8fcf-46a8-b509-4f8f0b794576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:59.931119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-78aca4f3-8fcf-46a8-b509-4f8f0b794576 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:37:59.932335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-78aca4f3-8fcf-46a8-b509-4f8f0b794576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:37:59.940049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 653/1292] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:37:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:37:59.966129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919bf7-dd0d-4365-a307-75c2dd8b7f24 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:37:59.979917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919bf7-dd0d-4365-a307-75c2dd8b7f24 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:37:59.984500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7ba51-3072-46f2-aa70-50bcb0ea02c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:37:59.985145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ba51-3072-46f2-aa70-50bcb0ea02c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:37:59.985420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ba51-3072-46f2-aa70-50bcb0ea02c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:37:59.985686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ba51-3072-46f2-aa70-50bcb0ea02c3 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:37:59.986415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7ba51-3072-46f2-aa70-50bcb0ea02c3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:37:59.988029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7ba51-3072-46f2-aa70-50bcb0ea02c3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:00.105347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 640/1293] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jan 17 09:37:59 2022] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:38:02.317405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8518d6-5f08-4b1b-b59e-0cc00c5235f9 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:02.317964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8518d6-5f08-4b1b-b59e-0cc00c5235f9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:02.317964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8518d6-5f08-4b1b-b59e-0cc00c5235f9 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:02.319758 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 654/1294] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:38:02.324779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f3f2-a915-47b4-b584-71f680807843 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:02.325193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f3f2-a915-47b4-b584-71f680807843 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:02.325336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f3f2-a915-47b4-b584-71f680807843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:02.343836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e084f3f2-a915-47b4-b584-71f680807843 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:38:02.345016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e084f3f2-a915-47b4-b584-71f680807843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:38:02.361554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 641/1295] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:38:02.385678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8518d6-5f08-4b1b-b59e-0cc00c5235f9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:38:02.398464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8518d6-5f08-4b1b-b59e-0cc00c5235f9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:38:02.403188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:38:02.403978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:02.404259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:02.404533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:02.405205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:38:02.406870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:02.418106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 17 09:38:02.419293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 655/1296] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:38:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:38:02.425349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f3f2-a915-47b4-b584-71f680807843 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:38:02.434431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f3f2-a915-47b4-b584-71f680807843 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:38:02.439013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:38:02.439662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:02.440029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:02.440308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:02.441025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:38:02.441838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:38:02.443453 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:02.448357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 642/1297] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Jan 17 09:38:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:38:02.454023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:38:02.464313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936eb8-cce6-4aa6-bca5-7da6d16d9eb1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:38:02.468913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec6ac9-109a-4fc7-b0fd-3a34aaa86120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:38:02.469553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6ac9-109a-4fc7-b0fd-3a34aaa86120 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:02.469834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6ac9-109a-4fc7-b0fd-3a34aaa86120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:02.470108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6ac9-109a-4fc7-b0fd-3a34aaa86120 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:02.470938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec6ac9-109a-4fc7-b0fd-3a34aaa86120 admin admin] RBAC: Adding query filter params (interface=public, service_id=f65655036cea42e5a9d92309f0d39910, region_id=RegionOne) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:38:02.471249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec6ac9-109a-4fc7-b0fd-3a34aaa86120 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:38:02.473436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec6ac9-109a-4fc7-b0fd-3a34aaa86120 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:02.478565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 656/1298] 10.222.0.88 () {56 vars in 1272 bytes} [Mon Jan 17 09:38:02 2022] GET /identity/v3/endpoints?service_id=f65655036cea42e5a9d92309f0d39910&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:38:02.484454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:38:02.495435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b871-e3e4-4dd5-ad45-ce18f43ba031 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:38:02.500452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ed73-8227-44ac-b656-a97192dd2020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:38:02.501142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ed73-8227-44ac-b656-a97192dd2020 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:02.508914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ed73-8227-44ac-b656-a97192dd2020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:02.508914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ed73-8227-44ac-b656-a97192dd2020 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:02.508914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6ed73-8227-44ac-b656-a97192dd2020 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:38:02.508914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6ed73-8227-44ac-b656-a97192dd2020 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:02.511070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 643/1299] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:38:02 2022] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:38:04.688838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47855-8a75-4fdd-991a-102f5b8235f6 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:04.689404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47855-8a75-4fdd-991a-102f5b8235f6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:04.689793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47855-8a75-4fdd-991a-102f5b8235f6 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:04.693718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 657/1300] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:38:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:38:04.699162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b83c9-38c2-446b-87b2-5c451d7c4b4c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:04.699593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b83c9-38c2-446b-87b2-5c451d7c4b4c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:04.699768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b83c9-38c2-446b-87b2-5c451d7c4b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:04.718168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-930b83c9-38c2-446b-87b2-5c451d7c4b4c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:38:04.719359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-930b83c9-38c2-446b-87b2-5c451d7c4b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:38:04.726920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 644/1301] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:38:04.750639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a47855-8a75-4fdd-991a-102f5b8235f6 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:38:04.763513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a47855-8a75-4fdd-991a-102f5b8235f6 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:38:04.767898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:38:04.768685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:04.768966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:04.769266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] PATH_INFO: `/v3/services/placement` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:04.770534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:38:04.772156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:04.783170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING keystone.server.flask.application [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 17 09:38:04.784300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 658/1302] 10.222.0.88 () {56 vars in 1138 bytes} [Mon Jan 17 09:38:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 17 09:38:04.790410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b83c9-38c2-446b-87b2-5c451d7c4b4c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:38:04.799456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b83c9-38c2-446b-87b2-5c451d7c4b4c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:38:04.803974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290bac9-010e-4624-b041-8fde2be03aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:38:04.804610 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290bac9-010e-4624-b041-8fde2be03aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:04.808918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290bac9-010e-4624-b041-8fde2be03aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:04.808918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290bac9-010e-4624-b041-8fde2be03aa8 admin admin] PATH_INFO: `/v3/services` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:04.808918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290bac9-010e-4624-b041-8fde2be03aa8 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:38:04.808918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290bac9-010e-4624-b041-8fde2be03aa8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:38:04.808918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290bac9-010e-4624-b041-8fde2be03aa8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:04.812919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 645/1303] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Jan 17 09:38:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:38:04.819125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:38:04.829044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0091d-1296-41aa-97a6-12a61b7b73cd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:38:04.834153 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6a69f-d20e-41f3-986a-49716dfb3b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:38:04.839921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a69f-d20e-41f3-986a-49716dfb3b19 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:38:04.839921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a69f-d20e-41f3-986a-49716dfb3b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:38:04.839921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a69f-d20e-41f3-986a-49716dfb3b19 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:38:04.839921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6a69f-d20e-41f3-986a-49716dfb3b19 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:38:04.839921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6a69f-d20e-41f3-986a-49716dfb3b19 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:38:04.938653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 659/1304] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jan 17 09:38:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:45:25.426835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba303f42-9f5e-4121-ba3c-e7824e969100 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:25.427403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba303f42-9f5e-4121-ba3c-e7824e969100 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:25.427403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba303f42-9f5e-4121-ba3c-e7824e969100 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:25.429170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 646/1305] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:25.435040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57bc39-fb87-4b52-8c2d-c3096aa12122 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:25.435520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57bc39-fb87-4b52-8c2d-c3096aa12122 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:25.435616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57bc39-fb87-4b52-8c2d-c3096aa12122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:25.572830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1d57bc39-fb87-4b52-8c2d-c3096aa12122 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:25.575126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1d57bc39-fb87-4b52-8c2d-c3096aa12122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:25.783099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 660/1306] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:25.803601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba303f42-9f5e-4121-ba3c-e7824e969100 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:25.805809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ba303f42-9f5e-4121-ba3c-e7824e969100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:25.936498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba303f42-9f5e-4121-ba3c-e7824e969100 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:26.034671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700a363-c8b1-4526-bc1e-31080fb257b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:26.035730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700a363-c8b1-4526-bc1e-31080fb257b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:26.036166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700a363-c8b1-4526-bc1e-31080fb257b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:26.036592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700a363-c8b1-4526-bc1e-31080fb257b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:26.037502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700a363-c8b1-4526-bc1e-31080fb257b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:26.039556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700a363-c8b1-4526-bc1e-31080fb257b8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:26.060317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 647/1307] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:45:25 2022] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:45:28.413118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8a427-758b-4924-884a-c74248ee710c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:28.413681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8a427-758b-4924-884a-c74248ee710c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:28.413681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8a427-758b-4924-884a-c74248ee710c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:28.415361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 661/1308] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:28.420701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624460-a2a4-413b-b208-564176741f17 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:28.421155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624460-a2a4-413b-b208-564176741f17 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:28.421247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624460-a2a4-413b-b208-564176741f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:28.621728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8e624460-a2a4-413b-b208-564176741f17 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:28.623020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8e624460-a2a4-413b-b208-564176741f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:28.716160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 648/1309] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:28.739827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8a427-758b-4924-884a-c74248ee710c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:28.741374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-60e8a427-758b-4924-884a-c74248ee710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:28.861545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8a427-758b-4924-884a-c74248ee710c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:28.955391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e859086-3352-400b-94b9-deea11326806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:28.956058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e859086-3352-400b-94b9-deea11326806 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:28.956338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e859086-3352-400b-94b9-deea11326806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:28.956611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e859086-3352-400b-94b9-deea11326806 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:28.957386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e859086-3352-400b-94b9-deea11326806 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:28.960672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e859086-3352-400b-94b9-deea11326806 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:28.985091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 662/1310] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:45:28 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:45:31.189262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9caf-3ec4-4e1d-ba22-398ab6a3130b None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:31.189806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9caf-3ec4-4e1d-ba22-398ab6a3130b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:31.189806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9caf-3ec4-4e1d-ba22-398ab6a3130b None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:31.191600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 649/1311] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:31.196753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e121-0c1c-40fd-b261-c1b05b8b4522 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:31.197145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e121-0c1c-40fd-b261-c1b05b8b4522 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:31.197307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e121-0c1c-40fd-b261-c1b05b8b4522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:31.264988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ae22e121-0c1c-40fd-b261-c1b05b8b4522 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:31.266195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ae22e121-0c1c-40fd-b261-c1b05b8b4522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:31.359818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 663/1312] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:31.410213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8f5e-23d3-4dff-a7da-b6bf5c305c0c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:31.410506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8f5e-23d3-4dff-a7da-b6bf5c305c0c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:31.410873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8f5e-23d3-4dff-a7da-b6bf5c305c0c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:31.412641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 650/1313] 10.222.0.88 () {54 vars in 964 bytes} [Mon Jan 17 09:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:31.419489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173942-37ea-4802-98df-741f67d7cfb3 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:31.419747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173942-37ea-4802-98df-741f67d7cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:31.421298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173942-37ea-4802-98df-741f67d7cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:31.493624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2f173942-37ea-4802-98df-741f67d7cfb3 None None] MFA Rules not processed for user `4bc44cadca4c4ac3a3264de0a4641437`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:31.494859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2f173942-37ea-4802-98df-741f67d7cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:31.567006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 664/1314] 10.222.0.88 () {58 vars in 1061 bytes} [Mon Jan 17 09:45:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:31.576126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f8f5e-23d3-4dff-a7da-b6bf5c305c0c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:31.577626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1b3f8f5e-23d3-4dff-a7da-b6bf5c305c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:31.676878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f8f5e-23d3-4dff-a7da-b6bf5c305c0c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:31.745175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5c65e-9862-43df-abb1-8c704259f370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:31.745818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5c65e-9862-43df-abb1-8c704259f370 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:31.746097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5c65e-9862-43df-abb1-8c704259f370 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:31.746371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5c65e-9862-43df-abb1-8c704259f370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:31.748013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9be5c65e-9862-43df-abb1-8c704259f370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:31.849773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5c65e-9862-43df-abb1-8c704259f370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:31.851224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5c65e-9862-43df-abb1-8c704259f370 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:31.868557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 651/1315] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:45:34.312416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0153-e32d-4cb9-b931-f0376dec0dc4 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:34.312944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0153-e32d-4cb9-b931-f0376dec0dc4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:34.312944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0153-e32d-4cb9-b931-f0376dec0dc4 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:34.314742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 665/1316] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:34.319891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:34.320270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:34.320435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:34.383103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:34.384278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:34.474445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 652/1317] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:34.507837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0153-e32d-4cb9-b931-f0376dec0dc4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:34.509354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-859b0153-e32d-4cb9-b931-f0376dec0dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:34.628394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0153-e32d-4cb9-b931-f0376dec0dc4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:34.722160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115f074-530c-40d8-9c19-603e99efc972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:34.723043 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f074-530c-40d8-9c19-603e99efc972 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:34.723323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f074-530c-40d8-9c19-603e99efc972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:34.723593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f074-530c-40d8-9c19-603e99efc972 admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:34.724500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115f074-530c-40d8-9c19-603e99efc972 admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:34.726298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115f074-530c-40d8-9c19-603e99efc972 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:34.728013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 666/1318] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:45:34 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:45:34.739564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:34.740741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:34.826871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094600a-df9e-4f8c-90f8-a779e5438db1 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:34.900317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0471a6-41be-4b43-a228-4919da4dd738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:34.900959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0471a6-41be-4b43-a228-4919da4dd738 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:34.901241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0471a6-41be-4b43-a228-4919da4dd738 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:34.902095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0471a6-41be-4b43-a228-4919da4dd738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:34.903740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8f0471a6-41be-4b43-a228-4919da4dd738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:35.005562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0471a6-41be-4b43-a228-4919da4dd738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:35.007018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0471a6-41be-4b43-a228-4919da4dd738 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:35.025532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 653/1319] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:45:37.721057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d436-0f2e-4afa-955c-40eed2ce3c21 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:37.721602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d436-0f2e-4afa-955c-40eed2ce3c21 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:37.721602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d436-0f2e-4afa-955c-40eed2ce3c21 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:37.723568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 667/1320] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:37.728480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8582cb6-8f11-4e74-b37e-1e7fe79ae8cd None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:37.728885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8582cb6-8f11-4e74-b37e-1e7fe79ae8cd None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:37.729032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8582cb6-8f11-4e74-b37e-1e7fe79ae8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:37.791659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b8582cb6-8f11-4e74-b37e-1e7fe79ae8cd None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:37.792843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b8582cb6-8f11-4e74-b37e-1e7fe79ae8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:37.892504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 654/1321] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:37.927226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d436-0f2e-4afa-955c-40eed2ce3c21 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:37.928737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9356d436-0f2e-4afa-955c-40eed2ce3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:38.049388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d436-0f2e-4afa-955c-40eed2ce3c21 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:38.136914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41968f5e-6196-4a83-ad5f-b0f2cf3a5d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:38.137760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968f5e-6196-4a83-ad5f-b0f2cf3a5d5d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:38.138290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968f5e-6196-4a83-ad5f-b0f2cf3a5d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:38.138556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968f5e-6196-4a83-ad5f-b0f2cf3a5d5d admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:38.148977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41968f5e-6196-4a83-ad5f-b0f2cf3a5d5d admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:38.151094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41968f5e-6196-4a83-ad5f-b0f2cf3a5d5d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:38.153597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 668/1322] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:45:37 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:45:38.181985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c478bb-9493-447b-bbc4-06fb92004358 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:38.182268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c478bb-9493-447b-bbc4-06fb92004358 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:38.182540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c478bb-9493-447b-bbc4-06fb92004358 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:38.184360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 655/1323] 10.222.0.88 () {54 vars in 964 bytes} [Mon Jan 17 09:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:38.190259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a817824-d6ad-44c9-b659-75be53ac4c28 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:38.190544 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a817824-d6ad-44c9-b659-75be53ac4c28 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:38.190855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a817824-d6ad-44c9-b659-75be53ac4c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:38.261782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2a817824-d6ad-44c9-b659-75be53ac4c28 None None] MFA Rules not processed for user `4bc44cadca4c4ac3a3264de0a4641437`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:38.263284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2a817824-d6ad-44c9-b659-75be53ac4c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:38.334307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 669/1324] 10.222.0.88 () {58 vars in 1061 bytes} [Mon Jan 17 09:45:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:38.343679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c478bb-9493-447b-bbc4-06fb92004358 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:38.345187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c5c478bb-9493-447b-bbc4-06fb92004358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:38.443705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c478bb-9493-447b-bbc4-06fb92004358 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:38.512241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ee3f4-faef-461d-ac8a-77da4ccbcec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:38.513611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ee3f4-faef-461d-ac8a-77da4ccbcec8 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:38.513891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ee3f4-faef-461d-ac8a-77da4ccbcec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:38.514166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ee3f4-faef-461d-ac8a-77da4ccbcec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:38.515879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-425ee3f4-faef-461d-ac8a-77da4ccbcec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:38.617578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ee3f4-faef-461d-ac8a-77da4ccbcec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:38.618959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ee3f4-faef-461d-ac8a-77da4ccbcec8 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:38.635972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 656/1325] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:45:42.182996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574d01-c6cf-4d8c-b2fa-40ca0bb236b5 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:42.183547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574d01-c6cf-4d8c-b2fa-40ca0bb236b5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:42.183547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574d01-c6cf-4d8c-b2fa-40ca0bb236b5 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:42.185296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 670/1326] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:42.190695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:42.191146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:42.191282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:42.257698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:42.258907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:42.348969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 657/1327] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:42.381900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e574d01-c6cf-4d8c-b2fa-40ca0bb236b5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:42.383428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4e574d01-c6cf-4d8c-b2fa-40ca0bb236b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:42.502723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e574d01-c6cf-4d8c-b2fa-40ca0bb236b5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:42.591349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8de9-df70-4211-a9b8-da66accd9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:42.592186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8de9-df70-4211-a9b8-da66accd9e6b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:42.592459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8de9-df70-4211-a9b8-da66accd9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:42.592726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8de9-df70-4211-a9b8-da66accd9e6b admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:42.603345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8de9-df70-4211-a9b8-da66accd9e6b admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:42.605423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8de9-df70-4211-a9b8-da66accd9e6b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:42.607467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 671/1328] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:45:42 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:45:42.622086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:42.624191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:42.712154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77319a-f781-48d8-b31c-cbe9b8c89c23 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:42.780745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a897f7-d815-4414-a686-b3e88500f100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:42.781484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a897f7-d815-4414-a686-b3e88500f100 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:42.781765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a897f7-d815-4414-a686-b3e88500f100 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:42.782034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a897f7-d815-4414-a686-b3e88500f100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:42.783667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b1a897f7-d815-4414-a686-b3e88500f100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:42.885460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a897f7-d815-4414-a686-b3e88500f100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:42.887021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a897f7-d815-4414-a686-b3e88500f100 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:42.904268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 658/1329] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:45:46.550073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97853bb-065b-4d25-af8a-19896bea7cb0 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:46.550604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97853bb-065b-4d25-af8a-19896bea7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:46.550604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97853bb-065b-4d25-af8a-19896bea7cb0 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:46.552424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 672/1330] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:46.557794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2be36e-5249-4a7e-a454-544a0716422c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:46.558186 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2be36e-5249-4a7e-a454-544a0716422c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:46.558483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2be36e-5249-4a7e-a454-544a0716422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:46.627575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-ce2be36e-5249-4a7e-a454-544a0716422c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:46.628672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ce2be36e-5249-4a7e-a454-544a0716422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:46.727898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 659/1331] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:46.765901 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97853bb-065b-4d25-af8a-19896bea7cb0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:46.767484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c97853bb-065b-4d25-af8a-19896bea7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:46.867409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97853bb-065b-4d25-af8a-19896bea7cb0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:46.938839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac386a-ad24-40f1-8ce8-2d70a9c78c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:46.939493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac386a-ad24-40f1-8ce8-2d70a9c78c5b service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:46.939772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac386a-ad24-40f1-8ce8-2d70a9c78c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:46.940044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac386a-ad24-40f1-8ce8-2d70a9c78c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:46.941682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-55ac386a-ad24-40f1-8ce8-2d70a9c78c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:47.054144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac386a-ad24-40f1-8ce8-2d70a9c78c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:47.055595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac386a-ad24-40f1-8ce8-2d70a9c78c5b service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:47.073685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 673/1332] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:45:49.376749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f72e5-f949-4e3a-b844-8b780fb4d61d None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:49.377147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f72e5-f949-4e3a-b844-8b780fb4d61d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:49.377300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f72e5-f949-4e3a-b844-8b780fb4d61d None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:49.379247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 660/1333] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:49.384358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d48a-d570-40d6-a437-1a62fe25b4ce None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:49.384778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d48a-d570-40d6-a437-1a62fe25b4ce None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:49.384912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d48a-d570-40d6-a437-1a62fe25b4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:49.448360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-7d86d48a-d570-40d6-a437-1a62fe25b4ce None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:49.449574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7d86d48a-d570-40d6-a437-1a62fe25b4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:49.542179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 674/1334] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:49.577741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f72e5-f949-4e3a-b844-8b780fb4d61d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:49.579337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-052f72e5-f949-4e3a-b844-8b780fb4d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:49.679687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f72e5-f949-4e3a-b844-8b780fb4d61d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:49.749532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b710d5d-e414-46a2-bb0b-6c2a968b53ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:49.750176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710d5d-e414-46a2-bb0b-6c2a968b53ad service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:49.750458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710d5d-e414-46a2-bb0b-6c2a968b53ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:49.750751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710d5d-e414-46a2-bb0b-6c2a968b53ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:49.752460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6b710d5d-e414-46a2-bb0b-6c2a968b53ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:49.858633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b710d5d-e414-46a2-bb0b-6c2a968b53ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:49.860117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b710d5d-e414-46a2-bb0b-6c2a968b53ad service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:49.877356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 661/1335] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:45:52.119994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0417-7f0a-4df1-960b-d1a083cbcbb5 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:52.120494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0417-7f0a-4df1-960b-d1a083cbcbb5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:52.120494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0417-7f0a-4df1-960b-d1a083cbcbb5 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:52.122238 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 675/1336] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:52.127407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:52.127825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:52.127966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:52.190484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:52.191712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:52.286212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 662/1337] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:52.319794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0417-7f0a-4df1-960b-d1a083cbcbb5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:52.321311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2a0d0417-7f0a-4df1-960b-d1a083cbcbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:52.448516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0417-7f0a-4df1-960b-d1a083cbcbb5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:52.537900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0bdf2-d3a7-4572-ba39-6fa1a0f56cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:52.538785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0bdf2-d3a7-4572-ba39-6fa1a0f56cfd admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:52.539066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0bdf2-d3a7-4572-ba39-6fa1a0f56cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:52.539337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0bdf2-d3a7-4572-ba39-6fa1a0f56cfd admin admin] PATH_INFO: `/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:52.549734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0bdf2-d3a7-4572-ba39-6fa1a0f56cfd admin admin] RBAC: Authorizing `identity:get_project(project_id=d174e4e879fc4a7f9d1c64d85c6c67bd)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:52.551856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0bdf2-d3a7-4572-ba39-6fa1a0f56cfd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:52.553646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 676/1338] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:45:52 2022] GET /identity/v3/projects/d174e4e879fc4a7f9d1c64d85c6c67bd => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:45:52.565047 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:52.566263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:52.653559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486397b-1fd3-49f9-bddd-622d2f305522 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:52.723863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09740b7e-c83d-48b4-b414-5c648be802d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:52.724423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740b7e-c83d-48b4-b414-5c648be802d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:52.724707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740b7e-c83d-48b4-b414-5c648be802d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:52.724974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740b7e-c83d-48b4-b414-5c648be802d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:52.726583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-09740b7e-c83d-48b4-b414-5c648be802d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:52.830745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09740b7e-c83d-48b4-b414-5c648be802d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:52.832187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09740b7e-c83d-48b4-b414-5c648be802d3 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:52.849629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 663/1339] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:45:55.523136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa08b-54f1-4b4f-aa08-a74d7702ef3c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:55.523573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa08b-54f1-4b4f-aa08-a74d7702ef3c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:55.523674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa08b-54f1-4b4f-aa08-a74d7702ef3c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:55.525450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 677/1340] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:55.531279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b2380-b10c-45dd-8d44-25e4825a12bb None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:55.531721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b2380-b10c-45dd-8d44-25e4825a12bb None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:55.531815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b2380-b10c-45dd-8d44-25e4825a12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:55.595466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-cd8b2380-b10c-45dd-8d44-25e4825a12bb None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:55.596667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cd8b2380-b10c-45dd-8d44-25e4825a12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:55.694024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 664/1341] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:55.730971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aa08b-54f1-4b4f-aa08-a74d7702ef3c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:55.734201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-603aa08b-54f1-4b4f-aa08-a74d7702ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:55.859422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aa08b-54f1-4b4f-aa08-a74d7702ef3c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:55.863283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38362aa-10ed-41b2-ac9d-eb6026d3c62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:55.863935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38362aa-10ed-41b2-ac9d-eb6026d3c62e service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:55.864217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38362aa-10ed-41b2-ac9d-eb6026d3c62e service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:55.864490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38362aa-10ed-41b2-ac9d-eb6026d3c62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:55.866431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e38362aa-10ed-41b2-ac9d-eb6026d3c62e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:55.977535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38362aa-10ed-41b2-ac9d-eb6026d3c62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:55.979171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38362aa-10ed-41b2-ac9d-eb6026d3c62e service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:55.999045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 678/1342] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:45:58.247163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a268c-b3d3-476c-978b-f5f95eb3b3a1 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:58.247688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a268c-b3d3-476c-978b-f5f95eb3b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:58.247688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a268c-b3d3-476c-978b-f5f95eb3b3a1 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:58.249493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 665/1343] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:45:58.254768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e73b-1464-47bb-be32-a6a53c06d6dd None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:58.255171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e73b-1464-47bb-be32-a6a53c06d6dd None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:58.255313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e73b-1464-47bb-be32-a6a53c06d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:58.299588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1414e73b-1464-47bb-be32-a6a53c06d6dd None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:45:58.300760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1414e73b-1464-47bb-be32-a6a53c06d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:45:58.308344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 679/1344] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:45:58.345746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a268c-b3d3-476c-978b-f5f95eb3b3a1 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:58.357525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a268c-b3d3-476c-978b-f5f95eb3b3a1 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:58.361898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c69ef1-d2b4-4332-83ef-0c2933b58e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:58.362754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69ef1-d2b4-4332-83ef-0c2933b58e99 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:58.363035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69ef1-d2b4-4332-83ef-0c2933b58e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:58.363308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69ef1-d2b4-4332-83ef-0c2933b58e99 admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:58.364512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c69ef1-d2b4-4332-83ef-0c2933b58e99 admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:58.366295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c69ef1-d2b4-4332-83ef-0c2933b58e99 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:58.368004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 666/1345] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:45:58 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:45:58.379612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414e73b-1464-47bb-be32-a6a53c06d6dd None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:45:58.388966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414e73b-1464-47bb-be32-a6a53c06d6dd None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:45:58.392485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cb10b-1e6e-4cc5-8007-3c0b2cdc16d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:45:58.393114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb10b-1e6e-4cc5-8007-3c0b2cdc16d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:45:58.393394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb10b-1e6e-4cc5-8007-3c0b2cdc16d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:45:58.393666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb10b-1e6e-4cc5-8007-3c0b2cdc16d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:45:58.402806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cb10b-1e6e-4cc5-8007-3c0b2cdc16d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:45:58.404232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cb10b-1e6e-4cc5-8007-3c0b2cdc16d2 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:45:58.413255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 680/1346] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:01.428215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde50c5-3d72-44ae-a4bd-ae54d926bc6c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:01.428791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde50c5-3d72-44ae-a4bd-ae54d926bc6c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:01.428791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde50c5-3d72-44ae-a4bd-ae54d926bc6c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:01.430499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 667/1347] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:01.436726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7df3f-6fa4-479d-b890-71895edfbebd None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:01.436726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7df3f-6fa4-479d-b890-71895edfbebd None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:01.437190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7df3f-6fa4-479d-b890-71895edfbebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:01.455065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-eec7df3f-6fa4-479d-b890-71895edfbebd None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:01.456393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-eec7df3f-6fa4-479d-b890-71895edfbebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:01.464104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 681/1348] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:01.500891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde50c5-3d72-44ae-a4bd-ae54d926bc6c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:01.511111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde50c5-3d72-44ae-a4bd-ae54d926bc6c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:01.515398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c127d8-1eb4-4cd7-877d-4efa74de0657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:01.516022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c127d8-1eb4-4cd7-877d-4efa74de0657 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:01.516299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c127d8-1eb4-4cd7-877d-4efa74de0657 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:01.516571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c127d8-1eb4-4cd7-877d-4efa74de0657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:01.525037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c127d8-1eb4-4cd7-877d-4efa74de0657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:01.526448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c127d8-1eb4-4cd7-877d-4efa74de0657 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:01.535399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 668/1349] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:06.217465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202fedc-3dfd-40b4-b15d-843ac11ed8a9 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:06.217926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202fedc-3dfd-40b4-b15d-843ac11ed8a9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:06.218038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202fedc-3dfd-40b4-b15d-843ac11ed8a9 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:06.220198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 682/1350] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:06.225365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce842c-c484-4b9d-8d4c-1a3a0043fcf7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:06.225798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce842c-c484-4b9d-8d4c-1a3a0043fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:06.225899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce842c-c484-4b9d-8d4c-1a3a0043fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:06.243901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-51ce842c-c484-4b9d-8d4c-1a3a0043fcf7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:06.245075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-51ce842c-c484-4b9d-8d4c-1a3a0043fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:06.253719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 669/1351] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:06.281658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202fedc-3dfd-40b4-b15d-843ac11ed8a9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:06.302989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202fedc-3dfd-40b4-b15d-843ac11ed8a9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:06.307524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e942cef-de92-4cb9-8111-1668023cc426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:06.308125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e942cef-de92-4cb9-8111-1668023cc426 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:06.308402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e942cef-de92-4cb9-8111-1668023cc426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:06.308670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e942cef-de92-4cb9-8111-1668023cc426 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:06.310036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e942cef-de92-4cb9-8111-1668023cc426 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:06.311913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e942cef-de92-4cb9-8111-1668023cc426 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:06.325645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 683/1352] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:46:06 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:46:08.554773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce40d4-d101-4c9b-a96c-a4a144f87c6c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:08.555272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce40d4-d101-4c9b-a96c-a4a144f87c6c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:08.555272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce40d4-d101-4c9b-a96c-a4a144f87c6c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:08.556982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 670/1353] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:08.562450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd82a-c7a2-46a1-b0e6-0b101acf1d17 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:08.562911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd82a-c7a2-46a1-b0e6-0b101acf1d17 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:08.563011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd82a-c7a2-46a1-b0e6-0b101acf1d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:08.580950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-339fd82a-c7a2-46a1-b0e6-0b101acf1d17 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:08.582128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-339fd82a-c7a2-46a1-b0e6-0b101acf1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:08.590104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 684/1354] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:08.623383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce40d4-d101-4c9b-a96c-a4a144f87c6c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:08.635751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce40d4-d101-4c9b-a96c-a4a144f87c6c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:08.643361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1211d-19b8-41a8-99c4-7cbac4ac9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:08.644221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1211d-19b8-41a8-99c4-7cbac4ac9b5a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:08.644501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1211d-19b8-41a8-99c4-7cbac4ac9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:08.644770 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1211d-19b8-41a8-99c4-7cbac4ac9b5a admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:08.646004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1211d-19b8-41a8-99c4-7cbac4ac9b5a admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:08.650252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1211d-19b8-41a8-99c4-7cbac4ac9b5a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:08.652153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 671/1355] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:46:08 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:46:08.665800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fd82a-c7a2-46a1-b0e6-0b101acf1d17 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:08.675047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fd82a-c7a2-46a1-b0e6-0b101acf1d17 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:08.678612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1786a-6f68-4278-bb49-a26640ffe424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:08.679278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1786a-6f68-4278-bb49-a26640ffe424 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:08.682207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1786a-6f68-4278-bb49-a26640ffe424 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:08.682207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1786a-6f68-4278-bb49-a26640ffe424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:08.688800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1786a-6f68-4278-bb49-a26640ffe424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:08.690227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1786a-6f68-4278-bb49-a26640ffe424 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:08.699528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 685/1356] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:12.406368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ccc2-47fa-42a8-a84c-5de339a9c344 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:12.406889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ccc2-47fa-42a8-a84c-5de339a9c344 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:12.406999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0ccc2-47fa-42a8-a84c-5de339a9c344 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:12.408751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 672/1357] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:12.414083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95e2c-2783-4a84-8ea7-c8273f83262c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:12.414489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95e2c-2783-4a84-8ea7-c8273f83262c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:12.414640 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95e2c-2783-4a84-8ea7-c8273f83262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:12.433279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-89d95e2c-2783-4a84-8ea7-c8273f83262c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:12.435008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-89d95e2c-2783-4a84-8ea7-c8273f83262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:12.442639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 686/1358] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:12.484027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ccc2-47fa-42a8-a84c-5de339a9c344 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:12.506489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0ccc2-47fa-42a8-a84c-5de339a9c344 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:12.512126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d0aa7-de79-4ac8-b714-6250e74bb645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:12.512775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0aa7-de79-4ac8-b714-6250e74bb645 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:12.513073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0aa7-de79-4ac8-b714-6250e74bb645 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:12.513333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d0aa7-de79-4ac8-b714-6250e74bb645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:12.522656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0aa7-de79-4ac8-b714-6250e74bb645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:12.525195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d0aa7-de79-4ac8-b714-6250e74bb645 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:12.537080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 673/1359] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:17.100637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a8cc-4c94-4404-9787-1e4a27637a3c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:17.101182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a8cc-4c94-4404-9787-1e4a27637a3c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:17.101182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a8cc-4c94-4404-9787-1e4a27637a3c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:17.102962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 687/1360] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:17.108247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce625ef-64eb-4cac-a2b5-ed53623c1d2f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:17.108713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce625ef-64eb-4cac-a2b5-ed53623c1d2f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:17.109073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce625ef-64eb-4cac-a2b5-ed53623c1d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:17.127607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dce625ef-64eb-4cac-a2b5-ed53623c1d2f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:17.128805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dce625ef-64eb-4cac-a2b5-ed53623c1d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:17.137730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 674/1361] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:17.175789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a8cc-4c94-4404-9787-1e4a27637a3c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:17.186861 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a8cc-4c94-4404-9787-1e4a27637a3c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:17.190327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed15b7-d0b7-45b6-a713-fb59e80f40da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:17.191003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed15b7-d0b7-45b6-a713-fb59e80f40da service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:17.191282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed15b7-d0b7-45b6-a713-fb59e80f40da service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:17.191655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed15b7-d0b7-45b6-a713-fb59e80f40da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:17.201661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed15b7-d0b7-45b6-a713-fb59e80f40da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:17.203211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed15b7-d0b7-45b6-a713-fb59e80f40da service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:17.212694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 688/1362] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:22.298265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d925-7384-4844-a1bf-3535ee32712a None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:22.299282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d925-7384-4844-a1bf-3535ee32712a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:22.299765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d925-7384-4844-a1bf-3535ee32712a None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:22.302123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 675/1363] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:46:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:22.307312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c70f-ae4f-4b85-a5f1-c0a68e7b4b11 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:22.308131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c70f-ae4f-4b85-a5f1-c0a68e7b4b11 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:22.308745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60c70f-ae4f-4b85-a5f1-c0a68e7b4b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:22.400344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-cb60c70f-ae4f-4b85-a5f1-c0a68e7b4b11 None None] MFA Rules not processed for user `64fd2d1e8d054688a294bcc718449005`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:22.401865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-cb60c70f-ae4f-4b85-a5f1-c0a68e7b4b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:22.493429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 689/1364] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:46:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:26.618837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b258c5-4175-4957-ae4d-ec48e86777af None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:26.619395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b258c5-4175-4957-ae4d-ec48e86777af None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:26.619643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b258c5-4175-4957-ae4d-ec48e86777af None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:26.622323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 676/1365] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:26.627301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90740aa6-a9a3-430b-ba42-eb641b84158d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:26.627754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90740aa6-a9a3-430b-ba42-eb641b84158d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:26.627920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90740aa6-a9a3-430b-ba42-eb641b84158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:26.647440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-90740aa6-a9a3-430b-ba42-eb641b84158d None None] MFA Rules not processed for user `64fd2d1e8d054688a294bcc718449005`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:26.648760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-90740aa6-a9a3-430b-ba42-eb641b84158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:26.657293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 690/1366] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:46:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:28.249452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd097-7407-4bcf-99da-af94983b10ce None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:28.250018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd097-7407-4bcf-99da-af94983b10ce None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:28.250018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd097-7407-4bcf-99da-af94983b10ce None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:28.251762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 677/1367] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:28.256720 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cfbe-5acd-4e66-9ea1-68760c53b5b6 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:28.257144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cfbe-5acd-4e66-9ea1-68760c53b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:28.257255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cfbe-5acd-4e66-9ea1-68760c53b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:28.275825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6b54cfbe-5acd-4e66-9ea1-68760c53b5b6 None None] MFA Rules not processed for user `64fd2d1e8d054688a294bcc718449005`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:28.276994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6b54cfbe-5acd-4e66-9ea1-68760c53b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:28.285408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 691/1368] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:46:31.973664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638799-dc7b-4ad3-8cde-9cc86d7b3b00 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:31.974227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638799-dc7b-4ad3-8cde-9cc86d7b3b00 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:31.974403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638799-dc7b-4ad3-8cde-9cc86d7b3b00 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:31.976458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 678/1369] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:31.981526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592700b1-f18d-44d2-ae3a-c8b2268f760d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:31.981945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592700b1-f18d-44d2-ae3a-c8b2268f760d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:31.982076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592700b1-f18d-44d2-ae3a-c8b2268f760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:32.001148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-592700b1-f18d-44d2-ae3a-c8b2268f760d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:32.002519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-592700b1-f18d-44d2-ae3a-c8b2268f760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:32.010930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 692/1370] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:32.060191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93dff-4fb9-403d-8c7b-8c8982f8c5d8 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:32.060710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93dff-4fb9-403d-8c7b-8c8982f8c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:32.061166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93dff-4fb9-403d-8c7b-8c8982f8c5d8 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:32.063146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 679/1371] 10.222.0.88 () {54 vars in 961 bytes} [Mon Jan 17 09:46:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:32.068708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bd30-52a1-46ab-9a83-33f172ee4bbd None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:32.069124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bd30-52a1-46ab-9a83-33f172ee4bbd None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:32.069563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bd30-52a1-46ab-9a83-33f172ee4bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:32.119042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2287bd30-52a1-46ab-9a83-33f172ee4bbd None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:32.120295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2287bd30-52a1-46ab-9a83-33f172ee4bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:32.202400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 693/1372] 10.222.0.88 () {58 vars in 1058 bytes} [Mon Jan 17 09:46:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:32.210937 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f93dff-4fb9-403d-8c7b-8c8982f8c5d8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:32.225078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f93dff-4fb9-403d-8c7b-8c8982f8c5d8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:32.230900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e600bb-4f8b-43e2-9248-1bf70ed5b5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:32.231525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e600bb-4f8b-43e2-9248-1bf70ed5b5d5 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:32.232043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e600bb-4f8b-43e2-9248-1bf70ed5b5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:32.232546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e600bb-4f8b-43e2-9248-1bf70ed5b5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:32.241240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e600bb-4f8b-43e2-9248-1bf70ed5b5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:32.243435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e600bb-4f8b-43e2-9248-1bf70ed5b5d5 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:32.258229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 680/1373] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:34.682406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df82d-43e6-471d-bd4b-21c4f77a8cdd None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:34.683000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df82d-43e6-471d-bd4b-21c4f77a8cdd None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:34.683000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df82d-43e6-471d-bd4b-21c4f77a8cdd None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:34.685484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 694/1374] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:34.690484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeae064-1898-4669-a9a3-b63f55e3d006 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:34.690936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeae064-1898-4669-a9a3-b63f55e3d006 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:34.691073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeae064-1898-4669-a9a3-b63f55e3d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:34.709313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-deeae064-1898-4669-a9a3-b63f55e3d006 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:34.710498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-deeae064-1898-4669-a9a3-b63f55e3d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:34.718790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 681/1375] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:34.764659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df82d-43e6-471d-bd4b-21c4f77a8cdd None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:34.781955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df82d-43e6-471d-bd4b-21c4f77a8cdd None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:34.787670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e3eb-92bc-4552-883e-731abd1841fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:34.788314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e3eb-92bc-4552-883e-731abd1841fa service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:34.788596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e3eb-92bc-4552-883e-731abd1841fa service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:34.788875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e3eb-92bc-4552-883e-731abd1841fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:34.798240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e3eb-92bc-4552-883e-731abd1841fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:34.799853 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e3eb-92bc-4552-883e-731abd1841fa service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:34.809890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 695/1376] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:37.483850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798337-2a60-4c56-a8e1-97ff47f8c76a None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:37.484325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798337-2a60-4c56-a8e1-97ff47f8c76a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:37.484434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798337-2a60-4c56-a8e1-97ff47f8c76a None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:37.486161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 682/1377] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:37.491502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fd8e8-8bb8-465f-ba83-8db3d50889cb None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:37.492005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fd8e8-8bb8-465f-ba83-8db3d50889cb None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:37.492111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fd8e8-8bb8-465f-ba83-8db3d50889cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:37.509700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-be9fd8e8-8bb8-465f-ba83-8db3d50889cb None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:37.510892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-be9fd8e8-8bb8-465f-ba83-8db3d50889cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:37.518790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 696/1378] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:37.564256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4f46-297d-4145-b9d4-b52a4caa722d None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:37.564677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4f46-297d-4145-b9d4-b52a4caa722d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:37.565099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4f46-297d-4145-b9d4-b52a4caa722d None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:37.567180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 683/1379] 10.222.0.88 () {54 vars in 961 bytes} [Mon Jan 17 09:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:37.572997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0adf7-3f18-42f5-be77-3506f2175a2b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:37.573285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0adf7-3f18-42f5-be77-3506f2175a2b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:37.573590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0adf7-3f18-42f5-be77-3506f2175a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:37.596153 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4cf0adf7-3f18-42f5-be77-3506f2175a2b None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:37.597325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4cf0adf7-3f18-42f5-be77-3506f2175a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:37.606549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 697/1380] 10.222.0.88 () {58 vars in 1058 bytes} [Mon Jan 17 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:46:37.614327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4f46-297d-4145-b9d4-b52a4caa722d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:37.628358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4f46-297d-4145-b9d4-b52a4caa722d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:37.633740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956b7e9-ea73-42a2-ad9c-929d79761877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:37.634433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956b7e9-ea73-42a2-ad9c-929d79761877 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:37.634806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956b7e9-ea73-42a2-ad9c-929d79761877 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:37.635178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956b7e9-ea73-42a2-ad9c-929d79761877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:37.644337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956b7e9-ea73-42a2-ad9c-929d79761877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:37.646002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956b7e9-ea73-42a2-ad9c-929d79761877 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:37.657046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 684/1381] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:40.106909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a0a71-6118-443a-bb3c-e36b0655599d None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.107445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a0a71-6118-443a-bb3c-e36b0655599d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.107445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a0a71-6118-443a-bb3c-e36b0655599d None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.109928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 698/1382] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:40.116049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b028b-b732-4b18-b4dd-83f680567911 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.116616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b028b-b732-4b18-b4dd-83f680567911 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.116616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b028b-b732-4b18-b4dd-83f680567911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.135190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-ca3b028b-b732-4b18-b4dd-83f680567911 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:40.136876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ca3b028b-b732-4b18-b4dd-83f680567911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:40.144869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 685/1383] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:40.145838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92ab18-adbb-4015-80c8-2e4989e5460f None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.146126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92ab18-adbb-4015-80c8-2e4989e5460f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.146400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92ab18-adbb-4015-80c8-2e4989e5460f None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.148341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 699/1384] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:40.153348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55265-505f-41a4-8cb4-ba3c976d983c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.153639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55265-505f-41a4-8cb4-ba3c976d983c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.153916 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55265-505f-41a4-8cb4-ba3c976d983c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.172662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-20a55265-505f-41a4-8cb4-ba3c976d983c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:40.173860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-20a55265-505f-41a4-8cb4-ba3c976d983c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:40.184040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 686/1385] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:40.228422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92ab18-adbb-4015-80c8-2e4989e5460f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:40.243808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92ab18-adbb-4015-80c8-2e4989e5460f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:40.249339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39891648-49ad-43d6-9881-b653fda0ef43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:40.249985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891648-49ad-43d6-9881-b653fda0ef43 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.250268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891648-49ad-43d6-9881-b653fda0ef43 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.250543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891648-49ad-43d6-9881-b653fda0ef43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.259116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39891648-49ad-43d6-9881-b653fda0ef43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:40.260712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39891648-49ad-43d6-9881-b653fda0ef43 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:40.270584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 700/1386] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:40.400354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556975-8c3d-4e08-b396-2e8c8ab2a8a6 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.400643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556975-8c3d-4e08-b396-2e8c8ab2a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.400926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556975-8c3d-4e08-b396-2e8c8ab2a8a6 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.403310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 687/1387] 10.222.0.88 () {54 vars in 963 bytes} [Mon Jan 17 09:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:40.408655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acafefe-6f53-425e-b809-2d8d0d746b6a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.409034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acafefe-6f53-425e-b809-2d8d0d746b6a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.409378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acafefe-6f53-425e-b809-2d8d0d746b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.457098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8acafefe-6f53-425e-b809-2d8d0d746b6a None None] MFA Rules not processed for user `fc6c69b3efe444c5893683fa61dc9dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:40.458274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8acafefe-6f53-425e-b809-2d8d0d746b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:40.520597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 701/1388] 10.222.0.88 () {58 vars in 1060 bytes} [Mon Jan 17 09:46:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:40.529117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556975-8c3d-4e08-b396-2e8c8ab2a8a6 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:40.545418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556975-8c3d-4e08-b396-2e8c8ab2a8a6 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:40.549606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a63342-7426-4183-a3da-836ce5e268a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:40.550369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63342-7426-4183-a3da-836ce5e268a5 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:40.550746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63342-7426-4183-a3da-836ce5e268a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:40.551141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63342-7426-4183-a3da-836ce5e268a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:40.561385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a63342-7426-4183-a3da-836ce5e268a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:40.562966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a63342-7426-4183-a3da-836ce5e268a5 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:40.574260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 688/1389] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:42.708912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abfdd9-04cd-449f-b35f-6beb71ffd8a3 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:42.709384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abfdd9-04cd-449f-b35f-6beb71ffd8a3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:42.709491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abfdd9-04cd-449f-b35f-6beb71ffd8a3 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:42.711390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 702/1390] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:42.717577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4c54-72c0-405a-b5b7-d64e28cb2707 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:42.718043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4c54-72c0-405a-b5b7-d64e28cb2707 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:42.718294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a4c54-72c0-405a-b5b7-d64e28cb2707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:42.736521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f10a4c54-72c0-405a-b5b7-d64e28cb2707 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:42.737714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f10a4c54-72c0-405a-b5b7-d64e28cb2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:42.746414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 689/1391] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:42.791316 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abfdd9-04cd-449f-b35f-6beb71ffd8a3 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:42.809603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abfdd9-04cd-449f-b35f-6beb71ffd8a3 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:42.815228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54949cfb-1381-491d-b9ee-99c7436bfe70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:42.815866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949cfb-1381-491d-b9ee-99c7436bfe70 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:42.816146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949cfb-1381-491d-b9ee-99c7436bfe70 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:42.816417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949cfb-1381-491d-b9ee-99c7436bfe70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:42.825193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54949cfb-1381-491d-b9ee-99c7436bfe70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:42.827025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54949cfb-1381-491d-b9ee-99c7436bfe70 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:42.844167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 703/1392] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:45.217387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042d2e0-243e-44c7-b99d-d264b6697fde None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:45.217902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042d2e0-243e-44c7-b99d-d264b6697fde None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:45.217902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042d2e0-243e-44c7-b99d-d264b6697fde None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:45.219637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 690/1393] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:45.224890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0576-96bb-4dd3-b0a1-860ab102c826 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:45.225388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0576-96bb-4dd3-b0a1-860ab102c826 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:45.225484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0576-96bb-4dd3-b0a1-860ab102c826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:45.244958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1ccd0576-96bb-4dd3-b0a1-860ab102c826 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:45.246348 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1ccd0576-96bb-4dd3-b0a1-860ab102c826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:45.256207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 704/1394] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:45.299808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042d2e0-243e-44c7-b99d-d264b6697fde None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:45.314505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042d2e0-243e-44c7-b99d-d264b6697fde None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:45.320435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f0679-3769-435d-9452-2b81126923ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:45.321387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f0679-3769-435d-9452-2b81126923ca service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:45.321738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f0679-3769-435d-9452-2b81126923ca service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:45.322083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f0679-3769-435d-9452-2b81126923ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:45.330844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f0679-3769-435d-9452-2b81126923ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:45.332487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f0679-3769-435d-9452-2b81126923ca service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:45.342815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 691/1395] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:47.747099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d55b9-7379-457e-b5a6-e47b1fadde42 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:47.747946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d55b9-7379-457e-b5a6-e47b1fadde42 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:47.748223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d55b9-7379-457e-b5a6-e47b1fadde42 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:47.750118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 705/1396] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:47.755389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858925-cf04-4f7f-b3f8-9ef852054e09 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:47.755811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858925-cf04-4f7f-b3f8-9ef852054e09 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:47.755946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858925-cf04-4f7f-b3f8-9ef852054e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:47.773524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3a858925-cf04-4f7f-b3f8-9ef852054e09 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:47.774685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3a858925-cf04-4f7f-b3f8-9ef852054e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:47.782949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 692/1397] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:47.824293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d55b9-7379-457e-b5a6-e47b1fadde42 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:47.839963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d55b9-7379-457e-b5a6-e47b1fadde42 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:47.845891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25435-ff2e-4222-af20-7871f932fcdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:47.846251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25435-ff2e-4222-af20-7871f932fcdf service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:47.846533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25435-ff2e-4222-af20-7871f932fcdf service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:47.846858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25435-ff2e-4222-af20-7871f932fcdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:47.855712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae25435-ff2e-4222-af20-7871f932fcdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:47.857269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae25435-ff2e-4222-af20-7871f932fcdf service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:47.867414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 706/1398] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:50.049696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0cb99-257c-4da4-b702-796496dd041d None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:50.050261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0cb99-257c-4da4-b702-796496dd041d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:50.050261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0cb99-257c-4da4-b702-796496dd041d None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:50.052027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 693/1399] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:50.057344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5d50-c1b3-4f27-a9ae-9702af1c5eea None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:50.058306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5d50-c1b3-4f27-a9ae-9702af1c5eea None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:50.058466 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5d50-c1b3-4f27-a9ae-9702af1c5eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:50.076556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6eef5d50-c1b3-4f27-a9ae-9702af1c5eea None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:50.077750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6eef5d50-c1b3-4f27-a9ae-9702af1c5eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:50.085469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 707/1400] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:50.129961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0cb99-257c-4da4-b702-796496dd041d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:50.145382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0cb99-257c-4da4-b702-796496dd041d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:50.150828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab9470-43d0-4749-b1a3-5e13bd61411b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:50.151474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9470-43d0-4749-b1a3-5e13bd61411b service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:50.151758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9470-43d0-4749-b1a3-5e13bd61411b service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:50.152037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9470-43d0-4749-b1a3-5e13bd61411b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:50.160328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab9470-43d0-4749-b1a3-5e13bd61411b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:50.161974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab9470-43d0-4749-b1a3-5e13bd61411b service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:50.171370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 694/1401] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:46:52.605925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063c5f-6017-4165-a1fb-ab4609ec82e8 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:52.606486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063c5f-6017-4165-a1fb-ab4609ec82e8 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:52.606486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063c5f-6017-4165-a1fb-ab4609ec82e8 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:52.608511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 708/1402] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:52.616267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29c74e-0bb8-4104-8682-32ae61ccec89 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:52.616695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29c74e-0bb8-4104-8682-32ae61ccec89 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:52.616969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29c74e-0bb8-4104-8682-32ae61ccec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:52.641631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8d29c74e-0bb8-4104-8682-32ae61ccec89 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:52.643443 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8d29c74e-0bb8-4104-8682-32ae61ccec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:52.657161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 695/1403] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:52.710173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063c5f-6017-4165-a1fb-ab4609ec82e8 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:52.728143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063c5f-6017-4165-a1fb-ab4609ec82e8 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:52.735907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57702c2-467c-4f61-8a8f-837b2b5d38d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:52.736752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57702c2-467c-4f61-8a8f-837b2b5d38d4 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:52.737105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57702c2-467c-4f61-8a8f-837b2b5d38d4 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:52.737710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57702c2-467c-4f61-8a8f-837b2b5d38d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:52.748534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57702c2-467c-4f61-8a8f-837b2b5d38d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:52.750841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57702c2-467c-4f61-8a8f-837b2b5d38d4 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:52.762995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 709/1404] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:55.165599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61995-4053-4867-ba37-e19651ee8362 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:55.166151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61995-4053-4867-ba37-e19651ee8362 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:55.166151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61995-4053-4867-ba37-e19651ee8362 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:55.167960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 696/1405] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:55.173130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af26e4-ffae-4401-b91b-793912728f26 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:55.173652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af26e4-ffae-4401-b91b-793912728f26 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:55.173652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af26e4-ffae-4401-b91b-793912728f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:55.191118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d9af26e4-ffae-4401-b91b-793912728f26 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:55.192291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d9af26e4-ffae-4401-b91b-793912728f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:55.201262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 710/1406] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:55.244792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a61995-4053-4867-ba37-e19651ee8362 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:55.259367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a61995-4053-4867-ba37-e19651ee8362 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:55.265625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fd550-851e-47b8-9092-115974d5795b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:55.266255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd550-851e-47b8-9092-115974d5795b service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:55.266534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd550-851e-47b8-9092-115974d5795b service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:55.266837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd550-851e-47b8-9092-115974d5795b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:55.274769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fd550-851e-47b8-9092-115974d5795b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:55.276335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fd550-851e-47b8-9092-115974d5795b service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:55.285368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 697/1407] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:55.893052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30f665-15c6-44dc-ba57-50fc802df085 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:55.893391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30f665-15c6-44dc-ba57-50fc802df085 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:55.893829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30f665-15c6-44dc-ba57-50fc802df085 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:55.895515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 711/1408] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:55.900870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2805-67f0-4cfc-bcf9-e36309c4baf7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:55.901769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2805-67f0-4cfc-bcf9-e36309c4baf7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:55.902070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2805-67f0-4cfc-bcf9-e36309c4baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:55.919731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-70bb2805-67f0-4cfc-bcf9-e36309c4baf7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:55.920978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-70bb2805-67f0-4cfc-bcf9-e36309c4baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:55.928843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 698/1409] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:55.985311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2c76-c191-4695-93fd-2aa0d0675d74 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:55.985598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2c76-c191-4695-93fd-2aa0d0675d74 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:55.985900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2c76-c191-4695-93fd-2aa0d0675d74 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:55.987712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 712/1410] 10.222.0.88 () {54 vars in 962 bytes} [Mon Jan 17 09:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:55.992814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b54fa-2cbb-4999-86c5-de1001712ae4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:55.993098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b54fa-2cbb-4999-86c5-de1001712ae4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:55.993369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b54fa-2cbb-4999-86c5-de1001712ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:56.040824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e74b54fa-2cbb-4999-86c5-de1001712ae4 None None] MFA Rules not processed for user `996e61ee837c4414a6bc725c617cf340`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:56.041996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e74b54fa-2cbb-4999-86c5-de1001712ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:56.101193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 699/1411] 10.222.0.88 () {58 vars in 1059 bytes} [Mon Jan 17 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:56.108826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c2c76-c191-4695-93fd-2aa0d0675d74 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:56.119234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c2c76-c191-4695-93fd-2aa0d0675d74 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:56.123291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea3472-e75e-453d-a34d-776d2d28c54f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:56.123918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea3472-e75e-453d-a34d-776d2d28c54f service glance] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:56.124203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea3472-e75e-453d-a34d-776d2d28c54f service glance] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:56.124529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea3472-e75e-453d-a34d-776d2d28c54f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:56.133443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea3472-e75e-453d-a34d-776d2d28c54f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:56.134919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea3472-e75e-453d-a34d-776d2d28c54f service glance] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:56.145094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 713/1412] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:46:56.687421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a405-eade-46fb-920f-7ca46a8ddc99 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:56.687991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a405-eade-46fb-920f-7ca46a8ddc99 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:56.687991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a405-eade-46fb-920f-7ca46a8ddc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:56.734807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3e62a405-eade-46fb-920f-7ca46a8ddc99 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:56.735990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3e62a405-eade-46fb-920f-7ca46a8ddc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:56.795841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 700/1413] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:56.840003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42864db6-804b-4432-a426-1c92c5db42c9 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:56.840484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42864db6-804b-4432-a426-1c92c5db42c9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:56.840589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42864db6-804b-4432-a426-1c92c5db42c9 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:56.842611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 714/1414] 10.222.0.88 () {54 vars in 942 bytes} [Mon Jan 17 09:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:56.849026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4a52-f0bc-4b15-9b63-765912acfd30 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:56.849314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4a52-f0bc-4b15-9b63-765912acfd30 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:56.849591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b4a52-f0bc-4b15-9b63-765912acfd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:56.896883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-9a5b4a52-f0bc-4b15-9b63-765912acfd30 None None] MFA Rules not processed for user `9c247c8b8bfe484bb39112144317e59c`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:56.898065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9a5b4a52-f0bc-4b15-9b63-765912acfd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:56.981866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 701/1415] 10.222.0.88 () {58 vars in 1039 bytes} [Mon Jan 17 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:56.991175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42864db6-804b-4432-a426-1c92c5db42c9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:57.004729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42864db6-804b-4432-a426-1c92c5db42c9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:57.009864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b955ba-2b07-451c-8b3f-56ae38a2c5c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:57.010793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b955ba-2b07-451c-8b3f-56ae38a2c5c7 service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:57.011079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b955ba-2b07-451c-8b3f-56ae38a2c5c7 service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:57.011350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b955ba-2b07-451c-8b3f-56ae38a2c5c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:57.019351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b955ba-2b07-451c-8b3f-56ae38a2c5c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:57.020919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b955ba-2b07-451c-8b3f-56ae38a2c5c7 service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:57.029453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 715/1416] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:46:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:46:57.728548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdb82-5d64-4770-b789-5ba9cca1daab None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:57.729133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdb82-5d64-4770-b789-5ba9cca1daab None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:57.729133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdb82-5d64-4770-b789-5ba9cca1daab None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:57.731299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 702/1417] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:46:57.736808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46471a64-9fd5-4b0a-a091-eade8d70abb8 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:57.737300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46471a64-9fd5-4b0a-a091-eade8d70abb8 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:57.737575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46471a64-9fd5-4b0a-a091-eade8d70abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:57.755866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-46471a64-9fd5-4b0a-a091-eade8d70abb8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:46:57.757057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-46471a64-9fd5-4b0a-a091-eade8d70abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:46:57.765988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 716/1418] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:46:57.810886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fdb82-5d64-4770-b789-5ba9cca1daab None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:46:57.825883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fdb82-5d64-4770-b789-5ba9cca1daab None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:46:57.831637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc64a8-fe04-4fe1-87e1-aab468356847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:46:57.845840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc64a8-fe04-4fe1-87e1-aab468356847 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:46:57.845840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc64a8-fe04-4fe1-87e1-aab468356847 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:46:57.845840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc64a8-fe04-4fe1-87e1-aab468356847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:46:57.845840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc64a8-fe04-4fe1-87e1-aab468356847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:46:57.845840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc64a8-fe04-4fe1-87e1-aab468356847 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:46:57.852686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 703/1419] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:00.230481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3cd8-72f7-4ac4-b6af-69ea6cf6000c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:00.231160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3cd8-72f7-4ac4-b6af-69ea6cf6000c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:00.231160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df3cd8-72f7-4ac4-b6af-69ea6cf6000c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:00.232872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 717/1420] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:00.238069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eed84-178e-423b-b1c1-f6db00d3a514 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:00.238515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eed84-178e-423b-b1c1-f6db00d3a514 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:00.238617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eed84-178e-423b-b1c1-f6db00d3a514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:00.258480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b25eed84-178e-423b-b1c1-f6db00d3a514 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:00.259719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b25eed84-178e-423b-b1c1-f6db00d3a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:00.269085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 704/1421] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:00.313938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3cd8-72f7-4ac4-b6af-69ea6cf6000c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:00.329311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df3cd8-72f7-4ac4-b6af-69ea6cf6000c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:00.335001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ceefd-bf0e-455d-be3e-d7730a546041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:00.335768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ceefd-bf0e-455d-be3e-d7730a546041 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:00.336120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ceefd-bf0e-455d-be3e-d7730a546041 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:00.336474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ceefd-bf0e-455d-be3e-d7730a546041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:00.348620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ceefd-bf0e-455d-be3e-d7730a546041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:00.350378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ceefd-bf0e-455d-be3e-d7730a546041 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:00.360051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 718/1422] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:21.373258 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188267a-b5e0-401e-b687-4b027de33f80 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:21.373771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188267a-b5e0-401e-b687-4b027de33f80 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:21.373873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188267a-b5e0-401e-b687-4b027de33f80 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:21.375634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 705/1423] 10.222.0.88 () {54 vars in 918 bytes} [Mon Jan 17 09:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:21.380841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea194c52-e682-4352-834e-219dd4f47c17 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:21.381285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea194c52-e682-4352-834e-219dd4f47c17 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:21.381391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea194c52-e682-4352-834e-219dd4f47c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:21.399626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ea194c52-e682-4352-834e-219dd4f47c17 None None] MFA Rules not processed for user `64fd2d1e8d054688a294bcc718449005`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:21.400800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ea194c52-e682-4352-834e-219dd4f47c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:21.420453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 719/1424] 10.222.0.88 () {58 vars in 1015 bytes} [Mon Jan 17 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:21.434442 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63405b3-c450-452a-9e0d-b4c479cfe0f2 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:21.435318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63405b3-c450-452a-9e0d-b4c479cfe0f2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:21.435609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63405b3-c450-452a-9e0d-b4c479cfe0f2 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:21.437360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 706/1425] 10.222.0.88 () {54 vars in 918 bytes} [Mon Jan 17 09:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:21.441953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cefb5-0470-4f8b-809f-de7e3aae5db4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:21.442240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cefb5-0470-4f8b-809f-de7e3aae5db4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:21.442516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cefb5-0470-4f8b-809f-de7e3aae5db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:21.460426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b79cefb5-0470-4f8b-809f-de7e3aae5db4 None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:21.461590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b79cefb5-0470-4f8b-809f-de7e3aae5db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:21.470521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 720/1426] 10.222.0.88 () {58 vars in 1015 bytes} [Mon Jan 17 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:24.130554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5a1d-9790-42a1-b974-12fe4e4b51fe None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:24.131155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5a1d-9790-42a1-b974-12fe4e4b51fe None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:24.131155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5a1d-9790-42a1-b974-12fe4e4b51fe None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:24.132884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 707/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:24.138909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074aa51-12b0-4d79-8467-9cc514ac8456 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:24.139329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074aa51-12b0-4d79-8467-9cc514ac8456 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:24.139464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074aa51-12b0-4d79-8467-9cc514ac8456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:24.157414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9074aa51-12b0-4d79-8467-9cc514ac8456 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:24.158570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9074aa51-12b0-4d79-8467-9cc514ac8456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:24.166271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 721/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:24.207613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5a1d-9790-42a1-b974-12fe4e4b51fe None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:24.222017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5a1d-9790-42a1-b974-12fe4e4b51fe None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:24.227388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b4d16-81d6-4e65-b330-13238a14efca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:24.228019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b4d16-81d6-4e65-b330-13238a14efca service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:24.228301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b4d16-81d6-4e65-b330-13238a14efca service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:24.228572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b4d16-81d6-4e65-b330-13238a14efca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:24.236355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b4d16-81d6-4e65-b330-13238a14efca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:24.237919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b4d16-81d6-4e65-b330-13238a14efca service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:24.246909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 708/1429] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:25.565076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8db949-93a3-4656-b20b-2d574a4b15c6 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:25.565581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8db949-93a3-4656-b20b-2d574a4b15c6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:25.565692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8db949-93a3-4656-b20b-2d574a4b15c6 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:25.567462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 722/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:25.572583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770294f-db1d-4c04-9f88-1831609d4f96 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:25.572973 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770294f-db1d-4c04-9f88-1831609d4f96 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:25.573173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770294f-db1d-4c04-9f88-1831609d4f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:25.592754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5770294f-db1d-4c04-9f88-1831609d4f96 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:25.593931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5770294f-db1d-4c04-9f88-1831609d4f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:25.601591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 709/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:25.769047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8db949-93a3-4656-b20b-2d574a4b15c6 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:25.783896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8db949-93a3-4656-b20b-2d574a4b15c6 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:25.789237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22376f2-81c4-4eb9-8455-b3506e1bb7fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:25.789859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22376f2-81c4-4eb9-8455-b3506e1bb7fa service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:25.790140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22376f2-81c4-4eb9-8455-b3506e1bb7fa service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:25.790414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22376f2-81c4-4eb9-8455-b3506e1bb7fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:25.798218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22376f2-81c4-4eb9-8455-b3506e1bb7fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:25.799868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22376f2-81c4-4eb9-8455-b3506e1bb7fa service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:25.809235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 723/1432] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:27.108154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9c23c-3bd3-40d2-ad2f-1c0138b4c35e None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:27.108724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9c23c-3bd3-40d2-ad2f-1c0138b4c35e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:27.108724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9c23c-3bd3-40d2-ad2f-1c0138b4c35e None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:27.110479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 710/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:27.115483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189290f-bdb5-43d6-b83e-70d3140e3cc0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:27.115872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189290f-bdb5-43d6-b83e-70d3140e3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:27.116049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189290f-bdb5-43d6-b83e-70d3140e3cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:27.133298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4189290f-bdb5-43d6-b83e-70d3140e3cc0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:27.134448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4189290f-bdb5-43d6-b83e-70d3140e3cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:27.142707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 724/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:27.293750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9c23c-3bd3-40d2-ad2f-1c0138b4c35e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:27.307669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9c23c-3bd3-40d2-ad2f-1c0138b4c35e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:27.313066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad851a8-7e8b-472b-8e45-31ff76e940d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:27.313691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad851a8-7e8b-472b-8e45-31ff76e940d8 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:27.313973 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad851a8-7e8b-472b-8e45-31ff76e940d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:27.314247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad851a8-7e8b-472b-8e45-31ff76e940d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:27.322029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad851a8-7e8b-472b-8e45-31ff76e940d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:27.323626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad851a8-7e8b-472b-8e45-31ff76e940d8 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:27.333193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 711/1435] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:28.632558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364c17-d448-4eb9-918c-67070ff777f1 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:28.633086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364c17-d448-4eb9-918c-67070ff777f1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:28.633086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364c17-d448-4eb9-918c-67070ff777f1 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:28.635083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 725/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:28.640464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ad8e0-f5e4-4549-885a-471ae9796956 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:28.640923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ad8e0-f5e4-4549-885a-471ae9796956 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:28.641031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ad8e0-f5e4-4549-885a-471ae9796956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:28.659225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-ac8ad8e0-f5e4-4549-885a-471ae9796956 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:28.660398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ac8ad8e0-f5e4-4549-885a-471ae9796956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:28.668088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 712/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:28.823780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364c17-d448-4eb9-918c-67070ff777f1 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:28.838362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364c17-d448-4eb9-918c-67070ff777f1 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:28.844402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61122f6-d34b-41b3-83de-d200ca948ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:28.845029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61122f6-d34b-41b3-83de-d200ca948ea0 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:28.845308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61122f6-d34b-41b3-83de-d200ca948ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:28.845578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61122f6-d34b-41b3-83de-d200ca948ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:28.853489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61122f6-d34b-41b3-83de-d200ca948ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:28.855089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61122f6-d34b-41b3-83de-d200ca948ea0 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:28.864268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 726/1438] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:30.230608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6a9de-eb64-4dae-85e4-41f32dda3f72 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:30.234898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6a9de-eb64-4dae-85e4-41f32dda3f72 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:30.234898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6a9de-eb64-4dae-85e4-41f32dda3f72 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:30.234898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 713/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:30.238633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c497f-412c-43bc-bf2c-0367a4e313b2 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:30.239057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c497f-412c-43bc-bf2c-0367a4e313b2 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:30.239210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c497f-412c-43bc-bf2c-0367a4e313b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:30.257523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c24c497f-412c-43bc-bf2c-0367a4e313b2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:30.258698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c24c497f-412c-43bc-bf2c-0367a4e313b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:30.266549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 727/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:30.420697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6a9de-eb64-4dae-85e4-41f32dda3f72 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:30.434438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6a9de-eb64-4dae-85e4-41f32dda3f72 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:30.439804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b08e4c-67eb-49b0-b46f-3173f3ad9750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:30.440414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b08e4c-67eb-49b0-b46f-3173f3ad9750 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:30.440693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b08e4c-67eb-49b0-b46f-3173f3ad9750 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:30.440964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b08e4c-67eb-49b0-b46f-3173f3ad9750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:30.448687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b08e4c-67eb-49b0-b46f-3173f3ad9750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:30.450272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b08e4c-67eb-49b0-b46f-3173f3ad9750 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:30.459374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 714/1441] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:31.760486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2d6a2-794e-4b4c-b595-0a54598ed88e None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:31.761049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2d6a2-794e-4b4c-b595-0a54598ed88e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:31.761049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2d6a2-794e-4b4c-b595-0a54598ed88e None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:31.762841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 728/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:31.767933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7dc3e-21ad-4d64-ae05-03409930d03e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:31.768360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7dc3e-21ad-4d64-ae05-03409930d03e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:31.768466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7dc3e-21ad-4d64-ae05-03409930d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:31.785919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-41a7dc3e-21ad-4d64-ae05-03409930d03e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:31.787167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-41a7dc3e-21ad-4d64-ae05-03409930d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:31.795428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 715/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:31.947373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2d6a2-794e-4b4c-b595-0a54598ed88e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:31.961486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2d6a2-794e-4b4c-b595-0a54598ed88e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:31.967465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12fe6d-23cb-4fa6-8f42-816ab1a90d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:31.968098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12fe6d-23cb-4fa6-8f42-816ab1a90d80 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:31.968381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12fe6d-23cb-4fa6-8f42-816ab1a90d80 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:31.968660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12fe6d-23cb-4fa6-8f42-816ab1a90d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:31.976737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12fe6d-23cb-4fa6-8f42-816ab1a90d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:31.978305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12fe6d-23cb-4fa6-8f42-816ab1a90d80 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:31.987995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 729/1444] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:33.291524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dceaee-be4a-467b-be09-72a2fad7dd68 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:33.292093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dceaee-be4a-467b-be09-72a2fad7dd68 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:33.292093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dceaee-be4a-467b-be09-72a2fad7dd68 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:33.293846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 716/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:33.298960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96983427-6857-4478-ac4a-170ca29b71db None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:33.299378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96983427-6857-4478-ac4a-170ca29b71db None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:33.299525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96983427-6857-4478-ac4a-170ca29b71db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:33.317903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-96983427-6857-4478-ac4a-170ca29b71db None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:33.319112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-96983427-6857-4478-ac4a-170ca29b71db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:33.327348 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 730/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:33.480701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dceaee-be4a-467b-be09-72a2fad7dd68 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:33.494563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dceaee-be4a-467b-be09-72a2fad7dd68 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:33.500905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d81b8-8f79-48e0-a348-b866052eeb6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:33.501535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d81b8-8f79-48e0-a348-b866052eeb6a service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:33.501811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d81b8-8f79-48e0-a348-b866052eeb6a service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:33.502079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d81b8-8f79-48e0-a348-b866052eeb6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:33.510528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d81b8-8f79-48e0-a348-b866052eeb6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:33.512125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d81b8-8f79-48e0-a348-b866052eeb6a service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:33.521750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 717/1447] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:34.799487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075cb5c-d07f-41fd-bce1-ede1e810eb21 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:34.803733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075cb5c-d07f-41fd-bce1-ede1e810eb21 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:34.803733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075cb5c-d07f-41fd-bce1-ede1e810eb21 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:34.803733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 731/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:34.806926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d638b-38e1-47e8-8432-dc98b6ce4c0d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:34.807352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d638b-38e1-47e8-8432-dc98b6ce4c0d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:34.807504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d638b-38e1-47e8-8432-dc98b6ce4c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:34.825953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-9f7d638b-38e1-47e8-8432-dc98b6ce4c0d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:34.827215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9f7d638b-38e1-47e8-8432-dc98b6ce4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:34.834868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 718/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:34.988607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075cb5c-d07f-41fd-bce1-ede1e810eb21 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:35.002532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075cb5c-d07f-41fd-bce1-ede1e810eb21 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:35.007954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26140197-d6a7-46ba-bc4a-4109270ca072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:35.008587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140197-d6a7-46ba-bc4a-4109270ca072 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:35.008867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140197-d6a7-46ba-bc4a-4109270ca072 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:35.009138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140197-d6a7-46ba-bc4a-4109270ca072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:35.017299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26140197-d6a7-46ba-bc4a-4109270ca072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:35.018894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26140197-d6a7-46ba-bc4a-4109270ca072 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:35.028589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 732/1450] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:36.333423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7481bd-3e11-4b5a-9493-e1b1b2b82599 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:36.334033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7481bd-3e11-4b5a-9493-e1b1b2b82599 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:36.334033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7481bd-3e11-4b5a-9493-e1b1b2b82599 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:36.335796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 719/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:36.341117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd66af-2bbc-46a1-b010-0378121a2e37 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:36.341532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd66af-2bbc-46a1-b010-0378121a2e37 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:36.341641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd66af-2bbc-46a1-b010-0378121a2e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:36.359593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-87bd66af-2bbc-46a1-b010-0378121a2e37 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:36.360751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-87bd66af-2bbc-46a1-b010-0378121a2e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:36.368650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 733/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:36.524511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7481bd-3e11-4b5a-9493-e1b1b2b82599 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:36.538838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7481bd-3e11-4b5a-9493-e1b1b2b82599 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:36.544735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37665c9c-54e6-4e87-82df-dda4aa621fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:36.545355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37665c9c-54e6-4e87-82df-dda4aa621fee service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:36.545632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37665c9c-54e6-4e87-82df-dda4aa621fee service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:36.545901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37665c9c-54e6-4e87-82df-dda4aa621fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:36.553613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37665c9c-54e6-4e87-82df-dda4aa621fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:36.555204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37665c9c-54e6-4e87-82df-dda4aa621fee service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:36.564046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 720/1453] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:38.675563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389c460-2752-4bd6-9cbc-992fc017ec41 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:38.676112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389c460-2752-4bd6-9cbc-992fc017ec41 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:38.676112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389c460-2752-4bd6-9cbc-992fc017ec41 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:38.677881 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 734/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:38.683332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c008-d447-4add-a285-4baf99b1354b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:38.683761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c008-d447-4add-a285-4baf99b1354b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:38.683887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c008-d447-4add-a285-4baf99b1354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:38.701092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6093c008-d447-4add-a285-4baf99b1354b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:38.702266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6093c008-d447-4add-a285-4baf99b1354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:38.709927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 721/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:38.748380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389c460-2752-4bd6-9cbc-992fc017ec41 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:38.750054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7389c460-2752-4bd6-9cbc-992fc017ec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:38.764454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389c460-2752-4bd6-9cbc-992fc017ec41 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:38.770785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69196d56-9f47-446b-847d-c63a2c0f98f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:38.770785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69196d56-9f47-446b-847d-c63a2c0f98f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:38.771023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69196d56-9f47-446b-847d-c63a2c0f98f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:38.771227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69196d56-9f47-446b-847d-c63a2c0f98f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:38.780794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69196d56-9f47-446b-847d-c63a2c0f98f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:38.782230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69196d56-9f47-446b-847d-c63a2c0f98f0 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:38.791426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 735/1456] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:41.143191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2f69-c04f-4841-8c13-8378903d958f None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:41.143785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2f69-c04f-4841-8c13-8378903d958f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:41.143785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2f69-c04f-4841-8c13-8378903d958f None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:41.145491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 722/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:41.151024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ea0b-4c82-4176-9a3c-7d4c88e520a9 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:41.151429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ea0b-4c82-4176-9a3c-7d4c88e520a9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:41.151539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ea0b-4c82-4176-9a3c-7d4c88e520a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:41.169845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-76a6ea0b-4c82-4176-9a3c-7d4c88e520a9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:41.171046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-76a6ea0b-4c82-4176-9a3c-7d4c88e520a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:41.178531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 736/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:41.216434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2f69-c04f-4841-8c13-8378903d958f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:41.226886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2f69-c04f-4841-8c13-8378903d958f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:41.230383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd13c9-22dc-481a-b5b5-7462fa29b485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:41.231685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd13c9-22dc-481a-b5b5-7462fa29b485 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:41.231968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd13c9-22dc-481a-b5b5-7462fa29b485 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:41.232249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd13c9-22dc-481a-b5b5-7462fa29b485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:41.240891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd13c9-22dc-481a-b5b5-7462fa29b485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:41.242305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd13c9-22dc-481a-b5b5-7462fa29b485 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:41.251372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 723/1459] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:43.830934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a708823-94a0-4007-9a1f-1c01c99773c0 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:43.831531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a708823-94a0-4007-9a1f-1c01c99773c0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:43.831531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a708823-94a0-4007-9a1f-1c01c99773c0 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:43.833412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 737/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:43.838566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c834d0-31c2-4b4a-978a-90fa22a91628 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:43.839037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c834d0-31c2-4b4a-978a-90fa22a91628 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:43.839142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c834d0-31c2-4b4a-978a-90fa22a91628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:43.857653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c1c834d0-31c2-4b4a-978a-90fa22a91628 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:43.858864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c1c834d0-31c2-4b4a-978a-90fa22a91628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:43.866629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 724/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:43.906549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a708823-94a0-4007-9a1f-1c01c99773c0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:43.921444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a708823-94a0-4007-9a1f-1c01c99773c0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:43.928981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8a9a7-ccce-4605-ab5f-005167d38918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:43.929620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a9a7-ccce-4605-ab5f-005167d38918 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:43.929900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a9a7-ccce-4605-ab5f-005167d38918 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:43.930173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a9a7-ccce-4605-ab5f-005167d38918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:43.939914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8a9a7-ccce-4605-ab5f-005167d38918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:43.941336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8a9a7-ccce-4605-ab5f-005167d38918 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:43.951220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 738/1462] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:46.232132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f56b-21d4-425a-97b2-59b7a2ce9000 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:46.232669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f56b-21d4-425a-97b2-59b7a2ce9000 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:46.232669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f56b-21d4-425a-97b2-59b7a2ce9000 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:46.234431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 725/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:46.239961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c471-c1d7-40ca-b4e3-41f6cd0070d2 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:46.240363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c471-c1d7-40ca-b4e3-41f6cd0070d2 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:46.240507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c471-c1d7-40ca-b4e3-41f6cd0070d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:46.258046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f4e2c471-c1d7-40ca-b4e3-41f6cd0070d2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:46.259507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f4e2c471-c1d7-40ca-b4e3-41f6cd0070d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:46.267683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 739/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:46.305587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f56b-21d4-425a-97b2-59b7a2ce9000 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:46.316541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f56b-21d4-425a-97b2-59b7a2ce9000 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:46.320036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f26b9-e6b3-4900-a87e-34d8572b6ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:46.320659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f26b9-e6b3-4900-a87e-34d8572b6ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:46.320939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f26b9-e6b3-4900-a87e-34d8572b6ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:46.321211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f26b9-e6b3-4900-a87e-34d8572b6ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:46.330383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f26b9-e6b3-4900-a87e-34d8572b6ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:46.331840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f26b9-e6b3-4900-a87e-34d8572b6ae8 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:46.343017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 726/1465] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:48.578462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d2da-aa0b-4f79-b9db-c547b6544673 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:48.579035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d2da-aa0b-4f79-b9db-c547b6544673 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:48.579035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d2da-aa0b-4f79-b9db-c547b6544673 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:48.580838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 740/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:48.586085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b11d-9a21-4f84-92ec-854ed83636a5 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:48.586465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b11d-9a21-4f84-92ec-854ed83636a5 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:48.586636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b11d-9a21-4f84-92ec-854ed83636a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:48.603792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-da88b11d-9a21-4f84-92ec-854ed83636a5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:48.604947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-da88b11d-9a21-4f84-92ec-854ed83636a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:48.612519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 727/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:48.650846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d2da-aa0b-4f79-b9db-c547b6544673 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:48.661152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d2da-aa0b-4f79-b9db-c547b6544673 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:48.664653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d120d8c-b2e6-4fbe-b0d1-7c4eb969302d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:48.665278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d120d8c-b2e6-4fbe-b0d1-7c4eb969302d service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:48.665556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d120d8c-b2e6-4fbe-b0d1-7c4eb969302d service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:48.665829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d120d8c-b2e6-4fbe-b0d1-7c4eb969302d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:48.674408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d120d8c-b2e6-4fbe-b0d1-7c4eb969302d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:48.675862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d120d8c-b2e6-4fbe-b0d1-7c4eb969302d service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:48.685434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 741/1468] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:50.940220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a09ce-b152-4ed5-84b4-b8b7d526c884 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:50.940797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a09ce-b152-4ed5-84b4-b8b7d526c884 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:50.940797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a09ce-b152-4ed5-84b4-b8b7d526c884 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:50.942548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 728/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:50.947981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f79fae-669e-4dc0-834d-fa4326cc3dd5 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:50.948419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f79fae-669e-4dc0-834d-fa4326cc3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:50.948535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f79fae-669e-4dc0-834d-fa4326cc3dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:50.966486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-06f79fae-669e-4dc0-834d-fa4326cc3dd5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:50.967688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-06f79fae-669e-4dc0-834d-fa4326cc3dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:50.975327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 742/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:51.014702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a09ce-b152-4ed5-84b4-b8b7d526c884 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:51.024993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a09ce-b152-4ed5-84b4-b8b7d526c884 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:51.028436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2c22e-140d-4367-93a9-a91b6a6565d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:51.029057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c22e-140d-4367-93a9-a91b6a6565d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:51.029334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c22e-140d-4367-93a9-a91b6a6565d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:51.029604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c22e-140d-4367-93a9-a91b6a6565d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:51.038147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2c22e-140d-4367-93a9-a91b6a6565d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:51.039606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2c22e-140d-4367-93a9-a91b6a6565d8 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:51.049199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 729/1471] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:53.296851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb2bbf-9a5e-48f0-9b0c-65ff9b258776 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:53.297415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb2bbf-9a5e-48f0-9b0c-65ff9b258776 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:53.297415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb2bbf-9a5e-48f0-9b0c-65ff9b258776 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:53.299274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 743/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:53.304550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28ce18-974a-4a4c-abb0-e4123f05dea8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:53.304953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28ce18-974a-4a4c-abb0-e4123f05dea8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:53.305102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28ce18-974a-4a4c-abb0-e4123f05dea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:53.323204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-ca28ce18-974a-4a4c-abb0-e4123f05dea8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:53.324405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ca28ce18-974a-4a4c-abb0-e4123f05dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:53.331954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 730/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:53.369438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb2bbf-9a5e-48f0-9b0c-65ff9b258776 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:53.380051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb2bbf-9a5e-48f0-9b0c-65ff9b258776 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:53.383501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c6f1b-b649-40f8-858c-7b4de3206643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:53.384376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c6f1b-b649-40f8-858c-7b4de3206643 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:53.384651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c6f1b-b649-40f8-858c-7b4de3206643 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:53.384925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c6f1b-b649-40f8-858c-7b4de3206643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:53.393454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c6f1b-b649-40f8-858c-7b4de3206643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:53.394894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c6f1b-b649-40f8-858c-7b4de3206643 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:53.403937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 744/1474] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:55.654568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e890-5c1f-429e-8944-429ca0248e4d None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:55.655145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e890-5c1f-429e-8944-429ca0248e4d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:55.655145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e890-5c1f-429e-8944-429ca0248e4d None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:55.656887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 731/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:55.671913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570295-282a-47ec-a32e-2c6ffc855d72 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:55.672424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570295-282a-47ec-a32e-2c6ffc855d72 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:55.672547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570295-282a-47ec-a32e-2c6ffc855d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:55.690460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-62570295-282a-47ec-a32e-2c6ffc855d72 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:55.691657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-62570295-282a-47ec-a32e-2c6ffc855d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:55.699325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 745/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:55.736436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865e890-5c1f-429e-8944-429ca0248e4d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:55.747321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865e890-5c1f-429e-8944-429ca0248e4d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:55.750801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628f7db-c158-4e72-a8a6-611fa98b0ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:55.751432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628f7db-c158-4e72-a8a6-611fa98b0ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:55.751719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628f7db-c158-4e72-a8a6-611fa98b0ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:55.751991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628f7db-c158-4e72-a8a6-611fa98b0ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:55.760844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628f7db-c158-4e72-a8a6-611fa98b0ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:55.762263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628f7db-c158-4e72-a8a6-611fa98b0ab7 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:55.771294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 732/1477] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:47:57.983826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085df84-5e5b-46b9-9b42-b658f5a4561a None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:57.984354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085df84-5e5b-46b9-9b42-b658f5a4561a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:57.984354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085df84-5e5b-46b9-9b42-b658f5a4561a None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:57.986061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 746/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:47:57.991254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300f353-94f1-4b87-816d-955f5c1cb488 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:57.991637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300f353-94f1-4b87-816d-955f5c1cb488 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:57.991804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300f353-94f1-4b87-816d-955f5c1cb488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:58.009235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2300f353-94f1-4b87-816d-955f5c1cb488 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:47:58.010417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2300f353-94f1-4b87-816d-955f5c1cb488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:47:58.018505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 733/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:47:58.055167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085df84-5e5b-46b9-9b42-b658f5a4561a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:47:58.065602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085df84-5e5b-46b9-9b42-b658f5a4561a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:47:58.069155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ab84b-aee9-4a91-8bd1-de0ed519a6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:47:58.069783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab84b-aee9-4a91-8bd1-de0ed519a6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:47:58.070067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab84b-aee9-4a91-8bd1-de0ed519a6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:47:58.070343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab84b-aee9-4a91-8bd1-de0ed519a6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:47:58.079516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ab84b-aee9-4a91-8bd1-de0ed519a6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:47:58.080944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ab84b-aee9-4a91-8bd1-de0ed519a6b5 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:47:58.090795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 747/1480] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:48:00.293367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438de58-6627-465c-af48-a050f142a751 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:00.293901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438de58-6627-465c-af48-a050f142a751 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:00.294013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438de58-6627-465c-af48-a050f142a751 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:00.295768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 734/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:00.301108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738aed-a207-475a-b98a-5f637c846e52 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:00.301482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738aed-a207-475a-b98a-5f637c846e52 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:00.301661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738aed-a207-475a-b98a-5f637c846e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:00.319023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e8738aed-a207-475a-b98a-5f637c846e52 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:00.320226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e8738aed-a207-475a-b98a-5f637c846e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:00.328564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 748/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:00.364956 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438de58-6627-465c-af48-a050f142a751 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:00.375985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438de58-6627-465c-af48-a050f142a751 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:00.379472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca638d96-0ef3-4500-8534-48ccf263240a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:00.380101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638d96-0ef3-4500-8534-48ccf263240a service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:00.380379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638d96-0ef3-4500-8534-48ccf263240a service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:00.380651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638d96-0ef3-4500-8534-48ccf263240a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:00.390035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638d96-0ef3-4500-8534-48ccf263240a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:00.391482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638d96-0ef3-4500-8534-48ccf263240a service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:00.400390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 735/1483] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:48:17.605300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8dfb5-cfde-4beb-898b-0037b354f92f None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:17.605976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8dfb5-cfde-4beb-898b-0037b354f92f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:17.605976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8dfb5-cfde-4beb-898b-0037b354f92f None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:17.607712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 749/1484] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:17.613140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5063-e6a6-4d37-88a7-7fc26526f4d7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:17.613570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5063-e6a6-4d37-88a7-7fc26526f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:17.613707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5063-e6a6-4d37-88a7-7fc26526f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:17.631620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b71d5063-e6a6-4d37-88a7-7fc26526f4d7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:17.632725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b71d5063-e6a6-4d37-88a7-7fc26526f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:17.641223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 736/1485] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:17.687551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a16c-81ea-480c-9710-60d1c2972328 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:17.687835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a16c-81ea-480c-9710-60d1c2972328 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:17.688110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2a16c-81ea-480c-9710-60d1c2972328 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:17.689880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 750/1486] 10.222.0.88 () {54 vars in 962 bytes} [Mon Jan 17 09:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:17.694654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf52f2f-8bb0-4d2f-8ebf-57d7fbf14df4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:17.694975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf52f2f-8bb0-4d2f-8ebf-57d7fbf14df4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:17.695255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf52f2f-8bb0-4d2f-8ebf-57d7fbf14df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:17.713359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-fbf52f2f-8bb0-4d2f-8ebf-57d7fbf14df4 None None] MFA Rules not processed for user `996e61ee837c4414a6bc725c617cf340`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:17.714522 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-fbf52f2f-8bb0-4d2f-8ebf-57d7fbf14df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:17.720863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 737/1487] 10.222.0.88 () {58 vars in 1059 bytes} [Mon Jan 17 09:48:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:17.727895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2a16c-81ea-480c-9710-60d1c2972328 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:17.738704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2a16c-81ea-480c-9710-60d1c2972328 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:17.742282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c454d0-160a-47a5-a904-d777580fb548 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:17.742945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c454d0-160a-47a5-a904-d777580fb548 service glance] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:17.743227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c454d0-160a-47a5-a904-d777580fb548 service glance] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:17.743500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c454d0-160a-47a5-a904-d777580fb548 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:17.752714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c454d0-160a-47a5-a904-d777580fb548 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:17.754137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c454d0-160a-47a5-a904-d777580fb548 service glance] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:17.764169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 751/1488] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:48:20.050131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413badcb-4aa0-4ce2-ae83-d90e49aec735 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:20.050691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413badcb-4aa0-4ce2-ae83-d90e49aec735 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:20.050691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413badcb-4aa0-4ce2-ae83-d90e49aec735 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:20.052506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 738/1489] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:20.057955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8f7e-db1a-41fa-ab57-b10dc116aee1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:20.058380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8f7e-db1a-41fa-ab57-b10dc116aee1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:20.058532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8f7e-db1a-41fa-ab57-b10dc116aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:20.075691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-43de8f7e-db1a-41fa-ab57-b10dc116aee1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:20.076849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-43de8f7e-db1a-41fa-ab57-b10dc116aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:20.084402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 752/1490] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:20.108976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413badcb-4aa0-4ce2-ae83-d90e49aec735 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:20.121158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413badcb-4aa0-4ce2-ae83-d90e49aec735 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:20.125699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253517c-02d2-4ca7-8f35-f82e8dd4efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:20.126339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253517c-02d2-4ca7-8f35-f82e8dd4efbf admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:20.126622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253517c-02d2-4ca7-8f35-f82e8dd4efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:20.126935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253517c-02d2-4ca7-8f35-f82e8dd4efbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:20.127677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253517c-02d2-4ca7-8f35-f82e8dd4efbf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:20.129530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253517c-02d2-4ca7-8f35-f82e8dd4efbf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:20.143526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 739/1491] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Jan 17 09:48:20 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:48:22.385411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f56c-dfa1-408e-8012-5f036b641d76 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:22.391362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f56c-dfa1-408e-8012-5f036b641d76 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:22.391362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f56c-dfa1-408e-8012-5f036b641d76 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:22.391362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 753/1492] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:22.393726 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519637d-bf83-4488-a99a-f87d34ddaeb1 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:22.394134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519637d-bf83-4488-a99a-f87d34ddaeb1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:22.394331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519637d-bf83-4488-a99a-f87d34ddaeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:22.412479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c519637d-bf83-4488-a99a-f87d34ddaeb1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:22.413905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c519637d-bf83-4488-a99a-f87d34ddaeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:22.421831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 740/1493] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:22.465141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f56c-dfa1-408e-8012-5f036b641d76 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:22.478980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f56c-dfa1-408e-8012-5f036b641d76 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:22.485200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f161025-f454-4875-bd71-5cef2bcd9129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:22.485839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f161025-f454-4875-bd71-5cef2bcd9129 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:22.486122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f161025-f454-4875-bd71-5cef2bcd9129 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:22.486401 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f161025-f454-4875-bd71-5cef2bcd9129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:22.494524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f161025-f454-4875-bd71-5cef2bcd9129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:22.496747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f161025-f454-4875-bd71-5cef2bcd9129 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:22.509144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 754/1494] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:48:24.843037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e9b2-6773-4b9b-82bb-f28279053f9b None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:24.843625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e9b2-6773-4b9b-82bb-f28279053f9b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:24.843625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493e9b2-6773-4b9b-82bb-f28279053f9b None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:24.845374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 741/1495] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:24.850627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec43306-e37a-4b08-966f-f7bc24b2dd38 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:24.851066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec43306-e37a-4b08-966f-f7bc24b2dd38 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:24.851207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec43306-e37a-4b08-966f-f7bc24b2dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:24.868441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6ec43306-e37a-4b08-966f-f7bc24b2dd38 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:24.869617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6ec43306-e37a-4b08-966f-f7bc24b2dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:24.877425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 755/1496] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:24.914340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493e9b2-6773-4b9b-82bb-f28279053f9b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:24.925304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493e9b2-6773-4b9b-82bb-f28279053f9b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:24.928902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd565c-f5b4-4362-a1fb-c3922571a940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:24.933650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd565c-f5b4-4362-a1fb-c3922571a940 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:24.933650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd565c-f5b4-4362-a1fb-c3922571a940 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:24.933650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd565c-f5b4-4362-a1fb-c3922571a940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:24.938842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd565c-f5b4-4362-a1fb-c3922571a940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:24.940366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd565c-f5b4-4362-a1fb-c3922571a940 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:24.950003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 742/1497] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:48:27.193943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b668e03-c174-4951-af15-a8f46dbdbc0c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:27.194483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b668e03-c174-4951-af15-a8f46dbdbc0c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:27.194602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b668e03-c174-4951-af15-a8f46dbdbc0c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:27.196413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 756/1498] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:27.201641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917050-daa8-4c5d-97c4-afda4e4705e2 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:27.202081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917050-daa8-4c5d-97c4-afda4e4705e2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:27.202222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917050-daa8-4c5d-97c4-afda4e4705e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:27.220629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-06917050-daa8-4c5d-97c4-afda4e4705e2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:27.221809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-06917050-daa8-4c5d-97c4-afda4e4705e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:27.229452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 743/1499] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:27.268000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b668e03-c174-4951-af15-a8f46dbdbc0c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:27.278328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b668e03-c174-4951-af15-a8f46dbdbc0c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:27.281803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37293a6-4c44-49fb-8896-74e8ef03ad87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:27.282423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37293a6-4c44-49fb-8896-74e8ef03ad87 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:27.282703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37293a6-4c44-49fb-8896-74e8ef03ad87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:27.283043 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37293a6-4c44-49fb-8896-74e8ef03ad87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:27.291635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37293a6-4c44-49fb-8896-74e8ef03ad87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:27.293541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37293a6-4c44-49fb-8896-74e8ef03ad87 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:27.302691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 757/1500] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:48:29.643611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247ece4-466d-4d16-8b1c-63e2ea624f07 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:29.644140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247ece4-466d-4d16-8b1c-63e2ea624f07 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:29.644140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247ece4-466d-4d16-8b1c-63e2ea624f07 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:29.645915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 744/1501] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:29.651279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739e6c4-d537-4fc2-9c86-ee8281dee792 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:29.651709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739e6c4-d537-4fc2-9c86-ee8281dee792 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:29.652311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739e6c4-d537-4fc2-9c86-ee8281dee792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:29.670052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4739e6c4-d537-4fc2-9c86-ee8281dee792 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:29.671244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4739e6c4-d537-4fc2-9c86-ee8281dee792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:29.678794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 758/1502] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:29.713501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247ece4-466d-4d16-8b1c-63e2ea624f07 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:29.726016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247ece4-466d-4d16-8b1c-63e2ea624f07 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:29.731046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964948fa-4b61-42eb-a8c1-77b2939f5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:29.731881 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964948fa-4b61-42eb-a8c1-77b2939f5659 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:29.732160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964948fa-4b61-42eb-a8c1-77b2939f5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:29.732436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964948fa-4b61-42eb-a8c1-77b2939f5659 admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:29.733618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964948fa-4b61-42eb-a8c1-77b2939f5659 admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:29.735436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964948fa-4b61-42eb-a8c1-77b2939f5659 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:29.737064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 745/1503] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:48:29 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:48:29.748395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739e6c4-d537-4fc2-9c86-ee8281dee792 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:29.757410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739e6c4-d537-4fc2-9c86-ee8281dee792 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:29.761241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643d907-ed89-4b27-816c-c185afbc21c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:29.761864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d907-ed89-4b27-816c-c185afbc21c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:29.762141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d907-ed89-4b27-816c-c185afbc21c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:29.762411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d907-ed89-4b27-816c-c185afbc21c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:29.771011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643d907-ed89-4b27-816c-c185afbc21c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:29.772410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643d907-ed89-4b27-816c-c185afbc21c9 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:29.781845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 759/1504] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:48:32.462253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae6c8-bc0a-4de3-a23e-79b5db806808 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:32.462789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae6c8-bc0a-4de3-a23e-79b5db806808 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:32.462789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae6c8-bc0a-4de3-a23e-79b5db806808 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:32.465209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 746/1505] 10.222.0.88 () {54 vars in 926 bytes} [Mon Jan 17 09:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:48:32.470429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816bd74-0238-4404-9627-351f9105208e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:32.470859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816bd74-0238-4404-9627-351f9105208e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:32.471187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816bd74-0238-4404-9627-351f9105208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:32.488519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9816bd74-0238-4404-9627-351f9105208e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:48:32.489695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9816bd74-0238-4404-9627-351f9105208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:48:32.497335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 760/1506] 10.222.0.88 () {58 vars in 1023 bytes} [Mon Jan 17 09:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:48:32.537196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae6c8-bc0a-4de3-a23e-79b5db806808 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:32.549997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae6c8-bc0a-4de3-a23e-79b5db806808 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:32.554450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a0895-0771-4413-a9ef-1978842bff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:32.555329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a0895-0771-4413-a9ef-1978842bff2f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:32.555607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a0895-0771-4413-a9ef-1978842bff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:32.555883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a0895-0771-4413-a9ef-1978842bff2f admin admin] PATH_INFO: `/v3/projects/21fc0e2d15dd458c8be52038432f65bf` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:32.557067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a0895-0771-4413-a9ef-1978842bff2f admin admin] RBAC: Authorizing `identity:get_project(project_id=21fc0e2d15dd458c8be52038432f65bf)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:32.558904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a0895-0771-4413-a9ef-1978842bff2f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:32.560722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 747/1507] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Jan 17 09:48:32 2022] GET /identity/v3/projects/21fc0e2d15dd458c8be52038432f65bf => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:48:32.571774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816bd74-0238-4404-9627-351f9105208e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:48:32.581439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816bd74-0238-4404-9627-351f9105208e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:48:32.584970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8459273-b1f0-4175-b5da-f07f8e991552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:48:32.585607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459273-b1f0-4175-b5da-f07f8e991552 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:48:32.585889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459273-b1f0-4175-b5da-f07f8e991552 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:48:32.586164 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459273-b1f0-4175-b5da-f07f8e991552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:48:32.595393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8459273-b1f0-4175-b5da-f07f8e991552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:48:32.596930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8459273-b1f0-4175-b5da-f07f8e991552 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:48:32.606048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 761/1508] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:49:55.815228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b40e3-6176-42e9-8fa6-6bc2f7e29416 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:55.815764 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b40e3-6176-42e9-8fa6-6bc2f7e29416 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:55.815764 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b40e3-6176-42e9-8fa6-6bc2f7e29416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:55.833336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c65b40e3-6176-42e9-8fa6-6bc2f7e29416 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:49:55.834514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c65b40e3-6176-42e9-8fa6-6bc2f7e29416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:49:55.842626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 748/1509] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:49:55.851677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce375-7d5c-4ee1-8b0c-286c046bd646 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:55.852138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce375-7d5c-4ee1-8b0c-286c046bd646 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:55.852246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce375-7d5c-4ee1-8b0c-286c046bd646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:55.869994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d91ce375-7d5c-4ee1-8b0c-286c046bd646 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:49:55.871191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d91ce375-7d5c-4ee1-8b0c-286c046bd646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:49:55.878818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 762/1510] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:49:55.883362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b40e3-6176-42e9-8fa6-6bc2f7e29416 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:55.892735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b40e3-6176-42e9-8fa6-6bc2f7e29416 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:55.897199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:55.897839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:55.898120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:55.898392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:55.899197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:49:55.899502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:55.901605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:55.912572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 749/1511] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:49:55.920969 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce375-7d5c-4ee1-8b0c-286c046bd646 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:55.929784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce375-7d5c-4ee1-8b0c-286c046bd646 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:55.934295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:55.934958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:55.935240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:55.935517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:55.936219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:55.938106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:56.036546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 763/1512] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:49:55 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:49:56.041348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:56.051031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1a754-4b1d-458f-b28b-025b13596c3f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:56.104131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:56.104784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.105067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.105348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.106039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:56.107978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:56.188962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 750/1513] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:49:56 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:49:56.193132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:56.203733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359540a9-1493-40b8-9c3f-8241c9245cc7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:56.208263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:56.208912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.209194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.209471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.210209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:56.211901 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:56.224780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 764/1514] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:49:56.228668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:56.238272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99ea2f-de41-4b7f-abdd-ccd487a37c3c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:56.242943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b903f0-2096-4e78-8fb4-c4c131bc18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:56.243597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b903f0-2096-4e78-8fb4-c4c131bc18da admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.243879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b903f0-2096-4e78-8fb4-c4c131bc18da admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.244154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b903f0-2096-4e78-8fb4-c4c131bc18da admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.244886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b903f0-2096-4e78-8fb4-c4c131bc18da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:56.246461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b903f0-2096-4e78-8fb4-c4c131bc18da admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:56.260190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 751/1515] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:49:56.264017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:56.273457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5eaaf-0619-452d-b3c7-0e25524ee34b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:56.278440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:56.279468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.279741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.280010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] PATH_INFO: `/v3/projects/be46e2d8272445e0a38b3a150bfe143f/users/84f5df90af1c431292abe400a3f66ff7/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.293947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be46e2d8272445e0a38b3a150bfe143f, user_id=84f5df90af1c431292abe400a3f66ff7, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:56.296550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:56.360729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 765/1516] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:49:56 2022] PUT /identity/v3/projects/be46e2d8272445e0a38b3a150bfe143f/users/84f5df90af1c431292abe400a3f66ff7/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:49:56.371849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd718-9f58-4e81-891e-cabbc59afcfe None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.372131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd718-9f58-4e81-891e-cabbc59afcfe None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.372402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd718-9f58-4e81-891e-cabbc59afcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.399349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3e0cd718-9f58-4e81-891e-cabbc59afcfe None None] MFA Rules not processed for user `84f5df90af1c431292abe400a3f66ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:49:56.401107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3e0cd718-9f58-4e81-891e-cabbc59afcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:49:56.459083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 752/1517] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:49:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:49:56.470529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:56.536243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9fb1-f059-4b6b-afa0-89cd377ff76c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:56.541697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:56.542335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.542614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.542916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.550575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:56.552123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:56.561107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 766/1518] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:49:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:49:56.627519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ec87-7053-47b1-be80-e21b18e1e5e0 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.627809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ec87-7053-47b1-be80-e21b18e1e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.628087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ec87-7053-47b1-be80-e21b18e1e5e0 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.629754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 753/1519] 10.222.0.88 () {52 vars in 829 bytes} [Mon Jan 17 09:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:49:56.633486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:56.691759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aa4d5-46aa-4f7d-bafe-cdc4a5b09012 service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:56.696271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:56.697664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:56.697945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:56.698216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] PATH_INFO: `/v3/users/84f5df90af1c431292abe400a3f66ff7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:56.699401 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f5df90af1c431292abe400a3f66ff7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:56.700422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:49:56.700422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:49:56.700422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:49:56.701614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:56.930069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f5df90af1c431292abe400a3f66ff7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:56.942619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f5df90af1c431292abe400a3f66ff7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:56.983618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f5df90af1c431292abe400a3f66ff7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:56.984221 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f5df90af1c431292abe400a3f66ff7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:57.004137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f5df90af1c431292abe400a3f66ff7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:57.010635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 767/1520] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:49:56 2022] DELETE /identity/v3/users/84f5df90af1c431292abe400a3f66ff7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:49:57.015189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:57.015644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:57.015820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:57.033181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:49:57.034488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:49:57.093471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 754/1521] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:49:57.103571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:57.105080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:49:57.159136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccceb6-c3b0-4e6f-ac88-4d9b435a504d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:57.162719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318d9a-4603-427a-b75c-92a7bcb8ce41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:57.163382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318d9a-4603-427a-b75c-92a7bcb8ce41 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:57.163665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318d9a-4603-427a-b75c-92a7bcb8ce41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:57.163939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318d9a-4603-427a-b75c-92a7bcb8ce41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:57.173491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe318d9a-4603-427a-b75c-92a7bcb8ce41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:57.174994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe318d9a-4603-427a-b75c-92a7bcb8ce41 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:57.184778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 768/1522] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:49:57.659948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:49:57.662464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:49:57.673337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dab3e-58a6-4cb0-9cd3-ea61782a5f9f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:49:57.677885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:49:57.678824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:49:57.679113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:49:57.679613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] PATH_INFO: `/v3/projects/be46e2d8272445e0a38b3a150bfe143f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:49:57.681691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be46e2d8272445e0a38b3a150bfe143f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:49:57.682717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:49:57.682717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:49:57.682717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:49:57.683963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:49:57.799549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be46e2d8272445e0a38b3a150bfe143f', 'request_id': 'req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:57.805353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be46e2d8272445e0a38b3a150bfe143f', 'request_id': 'req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:57.887041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be46e2d8272445e0a38b3a150bfe143f', 'request_id': 'req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:57.907313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] The token cache is being invalidate because project be46e2d8272445e0a38b3a150bfe143f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:49:57.907594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:57.908329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c4e269e9-8e99-4420-b1cb-6c9e74e5f6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:49:57.909853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 755/1523] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:49:57 2022] DELETE /identity/v3/projects/be46e2d8272445e0a38b3a150bfe143f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:51:27.328662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672de88-654e-4db1-8bd6-508754c7f5c4 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:27.329274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672de88-654e-4db1-8bd6-508754c7f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:27.329274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672de88-654e-4db1-8bd6-508754c7f5c4 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:27.331272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 769/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:27.336700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813c46-4654-49f3-97af-11ce1b3bd48f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:27.345182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813c46-4654-49f3-97af-11ce1b3bd48f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:27.345182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a813c46-4654-49f3-97af-11ce1b3bd48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:27.357449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-1a813c46-4654-49f3-97af-11ce1b3bd48f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:27.358612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1a813c46-4654-49f3-97af-11ce1b3bd48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:27.414682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 756/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:27.570182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672de88-654e-4db1-8bd6-508754c7f5c4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:27.571937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c672de88-654e-4db1-8bd6-508754c7f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:27.647725 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672de88-654e-4db1-8bd6-508754c7f5c4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:27.653477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf7e6a-ed4e-42f7-aaac-46104bdb69bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:27.654159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7e6a-ed4e-42f7-aaac-46104bdb69bc service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:27.654442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7e6a-ed4e-42f7-aaac-46104bdb69bc service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:27.654716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7e6a-ed4e-42f7-aaac-46104bdb69bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:27.662966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf7e6a-ed4e-42f7-aaac-46104bdb69bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:27.664561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf7e6a-ed4e-42f7-aaac-46104bdb69bc service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:27.674072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 770/1526] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:28.633591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e42f-63c7-4e6a-b3a7-8b19c35c2ed1 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:28.634117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e42f-63c7-4e6a-b3a7-8b19c35c2ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:28.634117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e42f-63c7-4e6a-b3a7-8b19c35c2ed1 None None] PATH_INFO: `/v3` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:28.635449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 757/1527] 10.222.0.94 () {54 vars in 925 bytes} [Mon Jan 17 09:51:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:51:28.642356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fdf7-77f7-4054-91b5-d153f927c830 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:28.642918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fdf7-77f7-4054-91b5-d153f927c830 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:28.643025 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fdf7-77f7-4054-91b5-d153f927c830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:28.664565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-fe23fdf7-77f7-4054-91b5-d153f927c830 None None] MFA Rules not processed for user `64fd2d1e8d054688a294bcc718449005`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:28.665752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fe23fdf7-77f7-4054-91b5-d153f927c830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:28.734095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 771/1528] 10.222.0.94 () {58 vars in 1015 bytes} [Mon Jan 17 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:28.962846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99449d-812b-4754-a8e1-d979c695ffd4 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:28.963062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99449d-812b-4754-a8e1-d979c695ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:28.963339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99449d-812b-4754-a8e1-d979c695ffd4 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:28.965201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:28.970249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12e0be-9faa-4f81-b7ad-f84df54aadf8 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:28.970546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12e0be-9faa-4f81-b7ad-f84df54aadf8 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:28.970867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12e0be-9faa-4f81-b7ad-f84df54aadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:28.989492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-0d12e0be-9faa-4f81-b7ad-f84df54aadf8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:28.990916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0d12e0be-9faa-4f81-b7ad-f84df54aadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:29.001662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:29.157700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99449d-812b-4754-a8e1-d979c695ffd4 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:29.172088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99449d-812b-4754-a8e1-d979c695ffd4 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:29.177501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1abdfe-2d98-4ce9-8d70-792eed31c714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:29.178158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1abdfe-2d98-4ce9-8d70-792eed31c714 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:29.178434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1abdfe-2d98-4ce9-8d70-792eed31c714 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:29.178704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1abdfe-2d98-4ce9-8d70-792eed31c714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:29.186620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1abdfe-2d98-4ce9-8d70-792eed31c714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:29.188221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1abdfe-2d98-4ce9-8d70-792eed31c714 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:29.197670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 759/1531] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:32.977414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2352c-38b8-4073-aa89-df2fd36bb70c None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:32.977941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2352c-38b8-4073-aa89-df2fd36bb70c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:32.977941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2352c-38b8-4073-aa89-df2fd36bb70c None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:32.979740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 773/1532] 10.222.0.88 () {54 vars in 960 bytes} [Mon Jan 17 09:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:32.984554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987c99-65a2-4239-80c5-847894b1c879 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:32.984992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987c99-65a2-4239-80c5-847894b1c879 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:32.985121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987c99-65a2-4239-80c5-847894b1c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:33.003920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8a987c99-65a2-4239-80c5-847894b1c879 None None] MFA Rules not processed for user `64fd2d1e8d054688a294bcc718449005`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:33.005102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8a987c99-65a2-4239-80c5-847894b1c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:33.014419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 760/1533] 10.222.0.88 () {58 vars in 1057 bytes} [Mon Jan 17 09:51:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:33.021856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2352c-38b8-4073-aa89-df2fd36bb70c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:33.035016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2352c-38b8-4073-aa89-df2fd36bb70c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:33.040436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27361c-e5f7-467f-8844-6f617f41118e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:33.041062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27361c-e5f7-467f-8844-6f617f41118e service placement] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:33.041343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27361c-e5f7-467f-8844-6f617f41118e service placement] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:33.041616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27361c-e5f7-467f-8844-6f617f41118e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:33.049635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27361c-e5f7-467f-8844-6f617f41118e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:33.051228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27361c-e5f7-467f-8844-6f617f41118e service placement] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:33.061130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 774/1534] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:40.873525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b5f8-4dda-4afe-872e-5af2494bdf9c None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:40.874064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b5f8-4dda-4afe-872e-5af2494bdf9c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:40.874181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b5f8-4dda-4afe-872e-5af2494bdf9c None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:40.875905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:40.881564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b421-68b4-42ed-a5b6-f0a0c9b7379b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:40.881993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b421-68b4-42ed-a5b6-f0a0c9b7379b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:40.882112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b421-68b4-42ed-a5b6-f0a0c9b7379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:40.899587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-3365b421-68b4-42ed-a5b6-f0a0c9b7379b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:40.900762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3365b421-68b4-42ed-a5b6-f0a0c9b7379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:40.908674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:41.063669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b5f8-4dda-4afe-872e-5af2494bdf9c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:41.077758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b5f8-4dda-4afe-872e-5af2494bdf9c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:41.083107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6114ad-2ce0-4db7-ae25-c35014c39299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:41.083742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6114ad-2ce0-4db7-ae25-c35014c39299 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:41.084017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6114ad-2ce0-4db7-ae25-c35014c39299 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:41.084286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6114ad-2ce0-4db7-ae25-c35014c39299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:41.092343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6114ad-2ce0-4db7-ae25-c35014c39299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:41.093939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6114ad-2ce0-4db7-ae25-c35014c39299 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:41.103503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 762/1537] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:42.378540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8199-cd2f-4c8e-873e-e125062eb3fc None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:42.379047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8199-cd2f-4c8e-873e-e125062eb3fc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:42.379158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e8199-cd2f-4c8e-873e-e125062eb3fc None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:42.380941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 776/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 17 09:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:51:42.386075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66902811-86e8-4956-b14d-7f4f550b5121 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:42.386518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66902811-86e8-4956-b14d-7f4f550b5121 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:42.386616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66902811-86e8-4956-b14d-7f4f550b5121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:42.404604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-66902811-86e8-4956-b14d-7f4f550b5121 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:42.405758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-66902811-86e8-4956-b14d-7f4f550b5121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:42.413870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 763/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 17 09:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:51:42.565508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8199-cd2f-4c8e-873e-e125062eb3fc None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:42.579991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e8199-cd2f-4c8e-873e-e125062eb3fc None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:42.585950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9372-0b5c-48a8-9013-20f83d0490a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:42.586578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9372-0b5c-48a8-9013-20f83d0490a4 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:42.586894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9372-0b5c-48a8-9013-20f83d0490a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:42.587168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9372-0b5c-48a8-9013-20f83d0490a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:42.595237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9372-0b5c-48a8-9013-20f83d0490a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:42.596825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9372-0b5c-48a8-9013-20f83d0490a4 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:42.606115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 777/1540] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:46.727997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9dc8-7dc8-4645-9808-9e4269c0a161 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:46.728530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9dc8-7dc8-4645-9808-9e4269c0a161 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:46.728530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9dc8-7dc8-4645-9808-9e4269c0a161 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:46.730319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 764/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:46.735621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc18621-45ca-48ba-86f8-a39ea0475111 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:46.736023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc18621-45ca-48ba-86f8-a39ea0475111 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:46.736180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc18621-45ca-48ba-86f8-a39ea0475111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:46.753917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1dc18621-45ca-48ba-86f8-a39ea0475111 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:46.755155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1dc18621-45ca-48ba-86f8-a39ea0475111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:46.762782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 778/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:46.799596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9dc8-7dc8-4645-9808-9e4269c0a161 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:46.801246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-221e9dc8-7dc8-4645-9808-9e4269c0a161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:46.856511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9dc8-7dc8-4645-9808-9e4269c0a161 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:46.860073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d44613-9ff0-4544-8290-25cac3b48c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:46.860701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44613-9ff0-4544-8290-25cac3b48c69 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:46.860982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44613-9ff0-4544-8290-25cac3b48c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:46.861254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44613-9ff0-4544-8290-25cac3b48c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:46.870239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d44613-9ff0-4544-8290-25cac3b48c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:46.871687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d44613-9ff0-4544-8290-25cac3b48c69 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:46.880967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 765/1543] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:49.052557 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4378b9-2895-45c3-b582-d11aea1c6afc None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:49.053201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4378b9-2895-45c3-b582-d11aea1c6afc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:49.053201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4378b9-2895-45c3-b582-d11aea1c6afc None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:49.054971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 779/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:49.060139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f3857-b965-452b-b68a-7feb6b2f8ef4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:49.060600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f3857-b965-452b-b68a-7feb6b2f8ef4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:49.060709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f3857-b965-452b-b68a-7feb6b2f8ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:49.078596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-400f3857-b965-452b-b68a-7feb6b2f8ef4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:49.079801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-400f3857-b965-452b-b68a-7feb6b2f8ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:49.087827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 766/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:49.126517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4378b9-2895-45c3-b582-d11aea1c6afc None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:49.138089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4378b9-2895-45c3-b582-d11aea1c6afc None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:49.141601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c1612-2cb1-4102-97fc-2043624d645c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:49.142228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c1612-2cb1-4102-97fc-2043624d645c service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:49.142509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c1612-2cb1-4102-97fc-2043624d645c service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:49.142813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c1612-2cb1-4102-97fc-2043624d645c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:49.151520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c1612-2cb1-4102-97fc-2043624d645c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:49.152946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c1612-2cb1-4102-97fc-2043624d645c service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:49.162065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 780/1546] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:53.037415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb552fd-6943-45ae-a394-dccaf7e73f0a None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:53.037990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb552fd-6943-45ae-a394-dccaf7e73f0a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:53.037990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb552fd-6943-45ae-a394-dccaf7e73f0a None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:53.039735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 767/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:53.044930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d01c8-16e7-4fb9-a610-df9cc5e28136 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:53.045346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d01c8-16e7-4fb9-a610-df9cc5e28136 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:53.045485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d01c8-16e7-4fb9-a610-df9cc5e28136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:53.063719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2b5d01c8-16e7-4fb9-a610-df9cc5e28136 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:53.064913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2b5d01c8-16e7-4fb9-a610-df9cc5e28136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:53.072603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 781/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:53.325010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb552fd-6943-45ae-a394-dccaf7e73f0a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:53.326574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-beb552fd-6943-45ae-a394-dccaf7e73f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:53.382272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb552fd-6943-45ae-a394-dccaf7e73f0a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:53.385845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d74577-de03-413c-9f28-3cef5adff845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:53.386495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d74577-de03-413c-9f28-3cef5adff845 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:53.386792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d74577-de03-413c-9f28-3cef5adff845 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:53.387070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d74577-de03-413c-9f28-3cef5adff845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:53.396129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d74577-de03-413c-9f28-3cef5adff845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:53.397547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d74577-de03-413c-9f28-3cef5adff845 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:53.406549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 768/1549] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:51:55.643244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41381-77c6-479b-8b79-8e2c4e1f1c2b None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:55.643814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41381-77c6-479b-8b79-8e2c4e1f1c2b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:55.643814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41381-77c6-479b-8b79-8e2c4e1f1c2b None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:55.645578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 782/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 17 09:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:55.651054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4566-6bd6-4d4d-b6d0-9f90d1bcf3b9 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:55.651527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4566-6bd6-4d4d-b6d0-9f90d1bcf3b9 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:55.651659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4566-6bd6-4d4d-b6d0-9f90d1bcf3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:55.669420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8dbc4566-6bd6-4d4d-b6d0-9f90d1bcf3b9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:55.670646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8dbc4566-6bd6-4d4d-b6d0-9f90d1bcf3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:55.679080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 769/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 17 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:55.931982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0343ef-16ba-4d55-b791-69c10183d2ec None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:55.932182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0343ef-16ba-4d55-b791-69c10183d2ec None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:55.932454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0343ef-16ba-4d55-b791-69c10183d2ec None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:55.934223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 783/1552] 10.222.0.88 () {54 vars in 963 bytes} [Mon Jan 17 09:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:51:55.939181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5bd23-12a9-457f-81cc-b24377bf394b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:55.939472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5bd23-12a9-457f-81cc-b24377bf394b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:55.939750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5bd23-12a9-457f-81cc-b24377bf394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:55.958169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-a4a5bd23-12a9-457f-81cc-b24377bf394b None None] MFA Rules not processed for user `fc6c69b3efe444c5893683fa61dc9dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:51:55.959388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a4a5bd23-12a9-457f-81cc-b24377bf394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:51:55.965735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 770/1553] 10.222.0.88 () {58 vars in 1060 bytes} [Mon Jan 17 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:51:55.973039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0343ef-16ba-4d55-b791-69c10183d2ec None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:51:55.983886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0343ef-16ba-4d55-b791-69c10183d2ec None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:51:55.987594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa7ae6-c820-41c4-8463-11796eb8dcbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:51:55.988217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7ae6-c820-41c4-8463-11796eb8dcbb service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:51:55.988501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7ae6-c820-41c4-8463-11796eb8dcbb service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:51:55.988773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7ae6-c820-41c4-8463-11796eb8dcbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:51:55.998060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa7ae6-c820-41c4-8463-11796eb8dcbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:51:55.999565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa7ae6-c820-41c4-8463-11796eb8dcbb service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:51:56.008864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 784/1554] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:18.484428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87b6f-49b6-44ab-a5ef-93701ea542be None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.485048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87b6f-49b6-44ab-a5ef-93701ea542be None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.485048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87b6f-49b6-44ab-a5ef-93701ea542be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.506163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7cf87b6f-49b6-44ab-a5ef-93701ea542be None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:18.507830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7cf87b6f-49b6-44ab-a5ef-93701ea542be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:18.520894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 771/1555] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:18.527057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14e86-664e-4601-9dbb-16b269c62811 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.534759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14e86-664e-4601-9dbb-16b269c62811 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.534759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14e86-664e-4601-9dbb-16b269c62811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.563372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f5c14e86-664e-4601-9dbb-16b269c62811 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:18.565083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f5c14e86-664e-4601-9dbb-16b269c62811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:18.576453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 785/1556] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:18.583207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf87b6f-49b6-44ab-a5ef-93701ea542be None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:18.599318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf87b6f-49b6-44ab-a5ef-93701ea542be None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:18.604530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a245514-5081-40a3-847a-f02ff0c1bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:18.605719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a245514-5081-40a3-847a-f02ff0c1bdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.606239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a245514-5081-40a3-847a-f02ff0c1bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.606757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a245514-5081-40a3-847a-f02ff0c1bdb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.607729 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a245514-5081-40a3-847a-f02ff0c1bdb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:18.608270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a245514-5081-40a3-847a-f02ff0c1bdb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:18.610134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a245514-5081-40a3-847a-f02ff0c1bdb1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:18.628604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 772/1557] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:18.637274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14e86-664e-4601-9dbb-16b269c62811 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:18.650066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0bbc1-0ecb-4416-9fa6-d02c967427ac None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.650702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0bbc1-0ecb-4416-9fa6-d02c967427ac None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.651237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0bbc1-0ecb-4416-9fa6-d02c967427ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.652210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14e86-664e-4601-9dbb-16b269c62811 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:18.658410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:18.662752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.662752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.662752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.662752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:18.662752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:18.689303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e7e0bbc1-0ecb-4416-9fa6-d02c967427ac None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:18.690952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e7e0bbc1-0ecb-4416-9fa6-d02c967427ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:18.707222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 773/1558] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:18.715270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d18f-3c0c-4591-b309-8f30dc78d725 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.715816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d18f-3c0c-4591-b309-8f30dc78d725 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.716298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d18f-3c0c-4591-b309-8f30dc78d725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.742259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b629d18f-3c0c-4591-b309-8f30dc78d725 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:18.743788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b629d18f-3c0c-4591-b309-8f30dc78d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:18.759855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 774/1559] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:18.764354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629d18f-3c0c-4591-b309-8f30dc78d725 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:18.775548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629d18f-3c0c-4591-b309-8f30dc78d725 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:18.780986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:18.781908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.782391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.783422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.784351 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:18.784857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:18.786696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:18.802393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 775/1560] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:18.815316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:18.826776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67f96-903c-4422-a766-40e55b9e816d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:18.830752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 786/1561] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:18 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:18.837402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:18.912965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db4612-8484-44f2-a760-000721964a2b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:18.924748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e778-334e-44f0-96fa-bba591af4e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:18.925486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1051d-0513-43db-8e90-50d3da11b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:18.925996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e778-334e-44f0-96fa-bba591af4e00 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.926184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1051d-0513-43db-8e90-50d3da11b106 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:18.926436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1051d-0513-43db-8e90-50d3da11b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.926707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1051d-0513-43db-8e90-50d3da11b106 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.927080 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e778-334e-44f0-96fa-bba591af4e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:18.927443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1051d-0513-43db-8e90-50d3da11b106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:18.927789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e778-334e-44f0-96fa-bba591af4e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:18.928698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e778-334e-44f0-96fa-bba591af4e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:18.929441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1051d-0513-43db-8e90-50d3da11b106 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:18.931083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e778-334e-44f0-96fa-bba591af4e00 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.025549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 787/1562] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:18 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:19.027133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9434e-214e-4b8e-9510-626d5e4d29d4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.027419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9434e-214e-4b8e-9510-626d5e4d29d4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.027694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9434e-214e-4b8e-9510-626d5e4d29d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.047179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-33d9434e-214e-4b8e-9510-626d5e4d29d4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.048367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-33d9434e-214e-4b8e-9510-626d5e4d29d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.056484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 788/1563] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.057981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a91d6-1a0b-4043-8357-1b61e46451d6 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.058313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a91d6-1a0b-4043-8357-1b61e46451d6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.058587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a91d6-1a0b-4043-8357-1b61e46451d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.059390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 776/1564] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:18 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:53:19.062653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1f411-2448-424c-920a-6ffd7b26c951 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.062653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1f411-2448-424c-920a-6ffd7b26c951 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.062653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1f411-2448-424c-920a-6ffd7b26c951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.080560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-0a5a91d6-1a0b-4043-8357-1b61e46451d6 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.080984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-37e1f411-2448-424c-920a-6ffd7b26c951 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.081777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0a5a91d6-1a0b-4043-8357-1b61e46451d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.082137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-37e1f411-2448-424c-920a-6ffd7b26c951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.137421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 789/1565] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.138899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 777/1566] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.139273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041d9b-bc66-41e3-bfe8-a878e40da6dc None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.139745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041d9b-bc66-41e3-bfe8-a878e40da6dc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.140215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041d9b-bc66-41e3-bfe8-a878e40da6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.140335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41c176-e026-4a18-bf2b-d851a66835ac None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.140501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41c176-e026-4a18-bf2b-d851a66835ac None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.140781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41c176-e026-4a18-bf2b-d851a66835ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.160942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6c41c176-e026-4a18-bf2b-d851a66835ac None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.161180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-98041d9b-bc66-41e3-bfe8-a878e40da6dc None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.162124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6c41c176-e026-4a18-bf2b-d851a66835ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.162285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-98041d9b-bc66-41e3-bfe8-a878e40da6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.169910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 778/1567] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.177552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 790/1568] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.177552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041d9b-bc66-41e3-bfe8-a878e40da6dc None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.177818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecca3-08be-43b8-9287-e26e4f76a5de None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.177818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecca3-08be-43b8-9287-e26e4f76a5de None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.177818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecca3-08be-43b8-9287-e26e4f76a5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.186620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041d9b-bc66-41e3-bfe8-a878e40da6dc None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.191903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6e44c-11af-436c-8ed0-53a91d5ea177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.192567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e44c-11af-436c-8ed0-53a91d5ea177 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.192849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e44c-11af-436c-8ed0-53a91d5ea177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.193123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6e44c-11af-436c-8ed0-53a91d5ea177 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.193855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e44c-11af-436c-8ed0-53a91d5ea177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.194102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-369ecca3-08be-43b8-9287-e26e4f76a5de None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.195293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-369ecca3-08be-43b8-9287-e26e4f76a5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.195521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6e44c-11af-436c-8ed0-53a91d5ea177 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.203250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 779/1569] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.204013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ecca3-08be-43b8-9287-e26e4f76a5de None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.208732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 791/1570] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:19.208732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87494591-bf01-4f15-a0ac-a6737311dd8c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.208732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87494591-bf01-4f15-a0ac-a6737311dd8c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.208732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87494591-bf01-4f15-a0ac-a6737311dd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.214120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ecca3-08be-43b8-9287-e26e4f76a5de None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.218605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.219285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.219588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.219850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.220602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.222512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.227448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-87494591-bf01-4f15-a0ac-a6737311dd8c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.228630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-87494591-bf01-4f15-a0ac-a6737311dd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.237606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 792/1571] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.242596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43cc6a-3c5e-43a9-8ba6-a114053ad3b9 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.242596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43cc6a-3c5e-43a9-8ba6-a114053ad3b9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.242596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43cc6a-3c5e-43a9-8ba6-a114053ad3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.257510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8d43cc6a-3c5e-43a9-8ba6-a114053ad3b9 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.258675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8d43cc6a-3c5e-43a9-8ba6-a114053ad3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.266405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 793/1572] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.267738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20dc7-30ce-4301-9ce6-44bfe2ca6fae None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.268022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20dc7-30ce-4301-9ce6-44bfe2ca6fae None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.268322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20dc7-30ce-4301-9ce6-44bfe2ca6fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.285518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c3f20dc7-30ce-4301-9ce6-44bfe2ca6fae None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.286646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c3f20dc7-30ce-4301-9ce6-44bfe2ca6fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.294210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 794/1573] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.295556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad27cf-c866-4d08-94e4-fc8e8da75e16 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.295840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad27cf-c866-4d08-94e4-fc8e8da75e16 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.296112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad27cf-c866-4d08-94e4-fc8e8da75e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.325216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d8ad27cf-c866-4d08-94e4-fc8e8da75e16 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.326421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d8ad27cf-c866-4d08-94e4-fc8e8da75e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.342955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 795/1574] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.344276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801444e0-1913-4765-9550-40f220fe6874 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.344563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801444e0-1913-4765-9550-40f220fe6874 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.344838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801444e0-1913-4765-9550-40f220fe6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.362269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 780/1575] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:19.362269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.367236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-801444e0-1913-4765-9550-40f220fe6874 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.368439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-801444e0-1913-4765-9550-40f220fe6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.380880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 796/1576] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.380880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a44e8-13d4-4956-8096-422fd7f247e7 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.380880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a44e8-13d4-4956-8096-422fd7f247e7 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.380880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a44e8-13d4-4956-8096-422fd7f247e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.381329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6314-b430-4bc7-bfdc-03ca45781494 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.385560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.386296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.386650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.387047 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.387861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.389486 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.398424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b67a44e8-13d4-4956-8096-422fd7f247e7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:19.399662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b67a44e8-13d4-4956-8096-422fd7f247e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:19.400086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 781/1577] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:19.400892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.410546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 797/1578] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:19.411380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a44e8-13d4-4956-8096-422fd7f247e7 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.412946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601ee2-28f3-44b2-9bbd-7c05f3b491fe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.417829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.418564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.418880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.419075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.419806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:19.420164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.420880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a44e8-13d4-4956-8096-422fd7f247e7 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.421698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.425633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.426269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.426552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.426892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.427631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:19.427939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.429515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.433695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 782/1579] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:19.434317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.443234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 798/1580] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:19.443962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.445113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683378d-90ff-48c7-98be-18d432194844 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.450050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.450506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.450824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.451254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.452037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:19.452346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.453190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e81469-37e3-402e-9195-02434dda9e0b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.453956 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.458289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.458968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.459245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.459514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.460230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:19.460531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.462098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.473320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 783/1581] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:19.473320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.478778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 799/1582] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:19.478778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.481592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa4fb4-8d1d-487b-a539-efb174634248 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.485454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086d38d-cce3-4528-a5d8-cba7e2316697 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.486456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.487144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.487422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.487693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.488427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.490013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.490160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.490692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.491020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.491279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.491997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:19.492442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.494042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.500659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 784/1583] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:19.502087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.507850 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 800/1584] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:19.508668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.511785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1cd7c-cfa8-41b6-8ae3-1187ee8d8cb1 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.516695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.518115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.518424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.518694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] PATH_INFO: `/v3/projects/51320950439a476392f62fc3620f9a82/users/489b6a782236474a927b20fe383e9162/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.518854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d9e47-7a34-4423-8fe3-441afd364e87 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.523438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.524053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.524335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.524606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.525328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:19.525632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.527250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.532978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51320950439a476392f62fc3620f9a82, user_id=489b6a782236474a927b20fe383e9162, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.535617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.538701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 801/1585] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:19.539554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.548844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e491d-1965-4b8e-842e-9023fea759e0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.556602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.556602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.556602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.556602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.556955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.557147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.599889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 785/1586] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:19 2022] PUT /identity/v3/projects/51320950439a476392f62fc3620f9a82/users/489b6a782236474a927b20fe383e9162/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:19.600828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.633296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 802/1587] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:19.634200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.660301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792862-bc42-4875-8967-ce9c2cf88785 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.698868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3fb72-c210-412b-8380-27bc9abdfe32 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.710157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.710866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.715095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.715095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.715095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.715095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.717573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.718250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.718656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.718966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.727806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.729886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.846222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 786/1588] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/projects => generated 357 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:19.847058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.858151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 803/1589] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:19.859222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.906155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66806-7ac5-4396-8895-02447c458293 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.917951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae104-daa1-4930-a6ef-ccb07b13d4b5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.923553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.924225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.924507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.924782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.925520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.927164 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.936631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 804/1590] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:19.937392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:19.947141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712179a-8561-4bf5-913d-0b8b26a97336 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:19.951919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.952487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.952769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.953044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.953761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.955720 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:19.960415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf6db7-7edb-44d6-8cb4-321ffabb8019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:19.961062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6db7-7edb-44d6-8cb4-321ffabb8019 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:19.961339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6db7-7edb-44d6-8cb4-321ffabb8019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:19.961609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6db7-7edb-44d6-8cb4-321ffabb8019 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:19.962312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf6db7-7edb-44d6-8cb4-321ffabb8019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:19.964332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf6db7-7edb-44d6-8cb4-321ffabb8019 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.037420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 805/1591] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.038214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.069294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 787/1592] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:19 2022] POST /identity/v3/projects => generated 389 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.069294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea32a-edd1-4bb8-8052-968bbe17f204 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.077856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea32a-edd1-4bb8-8052-968bbe17f204 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.077856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea32a-edd1-4bb8-8052-968bbe17f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.090925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8e6ea32a-edd1-4bb8-8052-968bbe17f204 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:20.092155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8e6ea32a-edd1-4bb8-8052-968bbe17f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:20.106223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59f3d4-49fe-47ac-a215-04d5a9df0df9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.157739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 788/1593] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:20.157739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea32a-edd1-4bb8-8052-968bbe17f204 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.160865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.161538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.161855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.162133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.162856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.164723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea32a-edd1-4bb8-8052-968bbe17f204 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.164854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.169646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.170303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.170588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.170900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.171602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.173545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.260284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 806/1594] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/projects => generated 391 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.260930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.277043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 789/1595] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.277043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.284291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0d99f-43f6-4e82-a01a-045cb2f52891 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.326327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378812-9f23-4ea2-bb67-4bb0ecd7026d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.331634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.332306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.332592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.332869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.333574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.335531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.342175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.342891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.343171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.343440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.344139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.346098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.440518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 807/1596] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/users => generated 279 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.441504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.450818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c9d7-1fa9-4782-8c9d-19e6319bd50e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.455405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.456235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.456516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.456791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] PATH_INFO: `/v3/projects/d5406dddbd4c47ca999f780e05d13368/users/b7c6362c55bc4bb4bac0de7cc23dc9e6/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.468897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 790/1597] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.469704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.471354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5406dddbd4c47ca999f780e05d13368, user_id=b7c6362c55bc4bb4bac0de7cc23dc9e6, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.474144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.479297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d82a80-aec9-4c71-b054-9a582b9b7e85 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.483919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.484564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.484871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.485147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.486336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.488286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.573608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 808/1598] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:20 2022] PUT /identity/v3/projects/d5406dddbd4c47ca999f780e05d13368/users/b7c6362c55bc4bb4bac0de7cc23dc9e6/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:20.574467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.585805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 791/1599] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.586977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.588979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:20.643059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415602d7-20f5-414f-b5d0-f5dcd58556c8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.647805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.648465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.649751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.650038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.650852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.650983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604e5f9-fabf-4672-ad04-cd8c5f6db96e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.652775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.696626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.697269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.697552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.697826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.707008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.708430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.717476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 792/1600] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:20.718296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.727494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6e32-4308-4342-8cd9-d53ff86ba17d service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.733475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e0291-b8e5-47ad-8196-3887e9748fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.733475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0291-b8e5-47ad-8196-3887e9748fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.733475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0291-b8e5-47ad-8196-3887e9748fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.733772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0291-b8e5-47ad-8196-3887e9748fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.734223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e0291-b8e5-47ad-8196-3887e9748fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.736200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e0291-b8e5-47ad-8196-3887e9748fc6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.754661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 809/1601] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.755509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.764823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee27dd2-f3de-42b8-8909-60a9fa078263 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.770017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.770648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.770971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.771246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.771973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.773550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.783039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 810/1602] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.783780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.792609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4ed8-98a6-4284-9692-395b3ba0f179 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.797117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.797702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.797989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.798263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.798991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.800491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.809759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 811/1603] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.810507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.820044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f04a53-2945-489f-8506-e482280ac38e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.824722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.825266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.825548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.825820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.826545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.828088 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.838533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 812/1604] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.839383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.848766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee700c5-4c90-4611-a13f-6998e74c0dd6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.853510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.854208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.854492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.854794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.855538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.856185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 793/1605] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:20.857131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.857910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1837a-57dd-4721-81e0-a6d8340a89c0 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.858508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1837a-57dd-4721-81e0-a6d8340a89c0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.859198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1837a-57dd-4721-81e0-a6d8340a89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.868040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 813/1606] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.869023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.880502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254610-1502-479e-86b4-b200bff16bc1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.885375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.886141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.886660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.887022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.887858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.889558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.889722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b5e1837a-57dd-4721-81e0-a6d8340a89c0 None None] MFA Rules not processed for user `b7c6362c55bc4bb4bac0de7cc23dc9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:20.891148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b5e1837a-57dd-4721-81e0-a6d8340a89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:20.901574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 814/1607] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.902653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.912592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baafe3e-1097-4a42-8c64-a81a3cb34142 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.919619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.919619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.919619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.919619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.919980 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.920840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.935936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 815/1608] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.939329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.946959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645de14-18c5-4b32-ad0e-3999d00f8b9f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.951749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.952395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.952676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.952946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.953666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.956048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.959740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 794/1609] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:20.960569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1837a-57dd-4721-81e0-a6d8340a89c0 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.968823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 816/1610] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.969485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:20.970338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1837a-57dd-4721-81e0-a6d8340a89c0 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.975158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.975836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.976996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.976996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.977177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.978683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.978952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27dc0-ac4a-468f-8392-d3c6145bd198 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:20.983668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:20.984307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:20.984588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:20.984868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:20.985646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:20.987249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:20.989035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 795/1611] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:20.989839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.000879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 817/1612] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:21.000879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.001642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978f005-3c01-4fd7-81bb-112e44953b2a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.006150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.006332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.006629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.006954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.007676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.009488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.009886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69c25-c035-4f89-acff-5bc1d50f9400 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.015357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.016167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.016529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.016949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.017882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.019646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.024068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 796/1613] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:21.024068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.030533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d30e3-7822-46d3-94b3-82e0c56e644d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.037913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 818/1614] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:21.037913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.038910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.040142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.040270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.040635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] PATH_INFO: `/v3/projects/55080e7eac8749b88c9b6cad42862b58/users/a28592c30b54403fa2c3236c9aeec804/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.049648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bab9a-678f-4d35-be34-b858bc32a145 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.056804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.057972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.058446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.058862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.060327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.063261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55080e7eac8749b88c9b6cad42862b58, user_id=a28592c30b54403fa2c3236c9aeec804, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.065318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.067232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.168292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 797/1615] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:21 2022] PUT /identity/v3/projects/55080e7eac8749b88c9b6cad42862b58/users/a28592c30b54403fa2c3236c9aeec804/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:21.169244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.230624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 819/1616] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:21.230624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.238383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c429f3e-cdfc-47ad-ac53-fcdb66ab0cf4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.295454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15371b1e-3aa4-4adc-9ec3-c745270a0025 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.297350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.298277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.298561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.298892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] PATH_INFO: `/v3/projects/08b806efef5643909294828d4173c36f/users/1855bc83a4784dfba26aae40aa45d829/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.300858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.302693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.302693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.302693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] PATH_INFO: `/v3/projects/4f78f5463ce84155836c42ee404f5665/users/f12d89fe1feb44c094e1321c41deac60/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.314175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b806efef5643909294828d4173c36f, user_id=1855bc83a4784dfba26aae40aa45d829, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.317169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.318684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f78f5463ce84155836c42ee404f5665, user_id=f12d89fe1feb44c094e1321c41deac60, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.321666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.405420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 798/1617] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:21 2022] PUT /identity/v3/projects/08b806efef5643909294828d4173c36f/users/1855bc83a4784dfba26aae40aa45d829/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:21.406253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.440673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 820/1618] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:21 2022] PUT /identity/v3/projects/4f78f5463ce84155836c42ee404f5665/users/f12d89fe1feb44c094e1321c41deac60/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:21.442505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.471623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575bde5-247a-4d36-b10b-81b22ecf2a9f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.506709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823dafc-21f9-4b19-a5f4-cfa438f74264 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.511345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00435c8f-e3f4-4f79-ba35-c68347f9b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.512224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435c8f-e3f4-4f79-ba35-c68347f9b372 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.512514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435c8f-e3f4-4f79-ba35-c68347f9b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.512788 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435c8f-e3f4-4f79-ba35-c68347f9b372 admin admin] PATH_INFO: `/v3/projects/9d833d073d534e56bcff57aead77b7e7/users/f230cf14688842a28afa95ad403436b6/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.526349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.526850 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00435c8f-e3f4-4f79-ba35-c68347f9b372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d833d073d534e56bcff57aead77b7e7, user_id=f230cf14688842a28afa95ad403436b6, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.527089 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.527357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.527660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.528427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.529562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00435c8f-e3f4-4f79-ba35-c68347f9b372 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.530029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.540718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 799/1619] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:21.541504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.550906 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7342fe-44b8-4816-a0f1-82f5f747a5fa admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.555550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.556548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.556831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.557104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] PATH_INFO: `/v3/projects/e71a78f8eb2445168288dcdc86badcab/users/15915c83afbe4addbcdd2ede00aa3d57/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.573088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71a78f8eb2445168288dcdc86badcab, user_id=15915c83afbe4addbcdd2ede00aa3d57, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.577808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.634471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 821/1620] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:21 2022] PUT /identity/v3/projects/9d833d073d534e56bcff57aead77b7e7/users/f230cf14688842a28afa95ad403436b6/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:21.635816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de499f17-9100-494c-a0cf-83811ee137cb None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.636709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de499f17-9100-494c-a0cf-83811ee137cb None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.636709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de499f17-9100-494c-a0cf-83811ee137cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.664602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-de499f17-9100-494c-a0cf-83811ee137cb None None] MFA Rules not processed for user `a28592c30b54403fa2c3236c9aeec804`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:21.669555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 800/1621] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:21 2022] PUT /identity/v3/projects/e71a78f8eb2445168288dcdc86badcab/users/15915c83afbe4addbcdd2ede00aa3d57/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:21.669685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-de499f17-9100-494c-a0cf-83811ee137cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:21.669781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.737362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 822/1622] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:21.738656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cde8-c93b-4268-af4c-242f2dd705e1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.738979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cde8-c93b-4268-af4c-242f2dd705e1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.739253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cde8-c93b-4268-af4c-242f2dd705e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.739889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31293-771c-4fad-9e71-526c430cf3c4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.745036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a844ee-3346-4e21-bbf7-30dd230ec6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.745694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a844ee-3346-4e21-bbf7-30dd230ec6cd admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.745971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a844ee-3346-4e21-bbf7-30dd230ec6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.746245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a844ee-3346-4e21-bbf7-30dd230ec6cd admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.747004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a844ee-3346-4e21-bbf7-30dd230ec6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.748996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a844ee-3346-4e21-bbf7-30dd230ec6cd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.756641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-7dd5cde8-c93b-4268-af4c-242f2dd705e1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:21.757837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7dd5cde8-c93b-4268-af4c-242f2dd705e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:21.765390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 823/1623] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:21.766594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25866-bf7e-4c3b-b210-8a671c92a61c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.767469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25866-bf7e-4c3b-b210-8a671c92a61c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.767749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25866-bf7e-4c3b-b210-8a671c92a61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.792689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-63b25866-bf7e-4c3b-b210-8a671c92a61c None None] MFA Rules not processed for user `1855bc83a4784dfba26aae40aa45d829`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:21.793859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-63b25866-bf7e-4c3b-b210-8a671c92a61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:21.855689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 824/1624] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:21.856581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25866-bf7e-4c3b-b210-8a671c92a61c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.866034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 801/1625] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:21.867333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913093c-6fd0-4267-8d99-5ac842b7b770 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.867467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913093c-6fd0-4267-8d99-5ac842b7b770 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.867718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913093c-6fd0-4267-8d99-5ac842b7b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.873222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25866-bf7e-4c3b-b210-8a671c92a61c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.879426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.880320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.880856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.881135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] PATH_INFO: `/v3/projects/9cb309ded717452cace3567dacc87b2f/users/8590cb39fdcb499ab21077e47371822e/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.886268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-1913093c-6fd0-4267-8d99-5ac842b7b770 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:21.887462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1913093c-6fd0-4267-8d99-5ac842b7b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:21.895255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 802/1626] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:21.896252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb309ded717452cace3567dacc87b2f, user_id=8590cb39fdcb499ab21077e47371822e, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.898988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:21.899806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1287272-836e-4c62-957a-87015538fd15 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.900098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1287272-836e-4c62-957a-87015538fd15 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.900378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1287272-836e-4c62-957a-87015538fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.917393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-a1287272-836e-4c62-957a-87015538fd15 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:21.918569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a1287272-836e-4c62-957a-87015538fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:21.926633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 803/1627] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:21.927513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1287272-836e-4c62-957a-87015538fd15 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:21.936748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1287272-836e-4c62-957a-87015538fd15 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:21.941920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:21.942547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:21.942870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:21.943151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:21.943846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:21.945733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.028184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 825/1628] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:21 2022] PUT /identity/v3/projects/9cb309ded717452cace3567dacc87b2f/users/8590cb39fdcb499ab21077e47371822e/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:22.029002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.074072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 804/1629] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:21 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:22.074072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.081368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520552c-280e-43b0-837a-b8b2f0743389 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.127756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.128399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.128684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.128952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.135483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ab5b1-5a22-4fdd-a4b8-d396768c26fa admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.138200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.139611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.140297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549297-1386-4aba-be79-76ab8fdac7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.141031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549297-1386-4aba-be79-76ab8fdac7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.141313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549297-1386-4aba-be79-76ab8fdac7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.141588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549297-1386-4aba-be79-76ab8fdac7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.142296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549297-1386-4aba-be79-76ab8fdac7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.144314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549297-1386-4aba-be79-76ab8fdac7a6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.149244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 826/1630] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:22.154030 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.159488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4b91-f26f-4764-b91a-cc7c1b6c9413 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.164610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.165335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.165562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.166314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.166568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.168181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.182562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 827/1631] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:22.183891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.194301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0be58-b9d4-4339-a60f-c96f90cd175d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.198211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.198882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.199167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.199444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.208709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.210146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.220490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 828/1632] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:22.221211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.229425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e503de1-b2fb-4b63-95d9-c0e53b94c6ff service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.232956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.233582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.233860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.234131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.244324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.245845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.248592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 805/1633] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:22 2022] POST /identity/v3/projects => generated 355 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:22.250326 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a0c97-2a90-4b8c-b976-64e5745c79e4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.250616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a0c97-2a90-4b8c-b976-64e5745c79e4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.250931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a0c97-2a90-4b8c-b976-64e5745c79e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.257059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 829/1634] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:22.257977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.269277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb720e7-cdd8-464d-be4e-77ade2a8f9c5 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.278229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d73a0c97-2a90-4b8c-b976-64e5745c79e4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:22.279499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d73a0c97-2a90-4b8c-b976-64e5745c79e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:22.356365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 806/1635] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:22.357170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a0c97-2a90-4b8c-b976-64e5745c79e4 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.373028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.373309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a0c97-2a90-4b8c-b976-64e5745c79e4 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.373416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.373416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.373416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.373931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.376923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.378779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d00233-1139-4785-a2c8-26eb5d229605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.379721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d00233-1139-4785-a2c8-26eb5d229605 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.380142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d00233-1139-4785-a2c8-26eb5d229605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.380607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d00233-1139-4785-a2c8-26eb5d229605 admin admin] PATH_INFO: `/v3/projects/2a4143284e004df6bb036825f5450ac8/users/411081f991ee44429af5582c322420d1/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.407969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d00233-1139-4785-a2c8-26eb5d229605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4143284e004df6bb036825f5450ac8, user_id=411081f991ee44429af5582c322420d1, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.407969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d00233-1139-4785-a2c8-26eb5d229605 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.548628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 830/1636] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:22 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:22.549625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.559021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e6544-baf8-465b-9eda-5957a1da9308 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.563886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.564533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.564815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.565090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.565803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.568220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.576229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 807/1637] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:22 2022] PUT /identity/v3/projects/2a4143284e004df6bb036825f5450ac8/users/411081f991ee44429af5582c322420d1/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:22.577701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af053fb9-56ef-42d1-a838-ae0f2cc35420 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.579875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af053fb9-56ef-42d1-a838-ae0f2cc35420 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.579875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af053fb9-56ef-42d1-a838-ae0f2cc35420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.606159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-af053fb9-56ef-42d1-a838-ae0f2cc35420 None None] MFA Rules not processed for user `489b6a782236474a927b20fe383e9162`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:22.607450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-af053fb9-56ef-42d1-a838-ae0f2cc35420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:22.666818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 831/1638] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:22 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:22.668801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.673584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 808/1639] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:22.674434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af053fb9-56ef-42d1-a838-ae0f2cc35420 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.743358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90017e83-7aab-467c-8be1-1b24c5b43dbc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.770169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af053fb9-56ef-42d1-a838-ae0f2cc35420 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.781555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.782285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.782591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.782955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.783724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.785370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.799575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.800352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.800636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.800909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.801748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 809/1640] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:22.802761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.811328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.812732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516496a6-ad7d-462f-94c0-538f23f825ab admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.812918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.818121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27493a-ec4e-4bc8-bd9e-c863e837b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.818839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27493a-ec4e-4bc8-bd9e-c863e837b7fd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.819125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27493a-ec4e-4bc8-bd9e-c863e837b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.819872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27493a-ec4e-4bc8-bd9e-c863e837b7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.820115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27493a-ec4e-4bc8-bd9e-c863e837b7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.821927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27493a-ec4e-4bc8-bd9e-c863e837b7fd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.823658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 832/1641] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:22.824300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.836111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 810/1642] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:22.836111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4982-31dc-4a6b-8ba5-ae7337a40349 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.836407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70db5-0a44-4e13-916c-02dad438f8cf service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.836521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4982-31dc-4a6b-8ba5-ae7337a40349 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.836521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4982-31dc-4a6b-8ba5-ae7337a40349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.841579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.842036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.842383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.842805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.843573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.845347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.854665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f66a4982-31dc-4a6b-8ba5-ae7337a40349 None None] MFA Rules not processed for user `489b6a782236474a927b20fe383e9162`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:22.859214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f66a4982-31dc-4a6b-8ba5-ae7337a40349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:22.859352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 833/1643] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:22.859352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.867861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 811/1644] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:22.868565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a4982-31dc-4a6b-8ba5-ae7337a40349 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.877946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f216f1-5cad-4161-92ae-51178a2cc1e7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.883916 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a4982-31dc-4a6b-8ba5-ae7337a40349 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.885115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a36c8-a2f7-4a70-85df-a74cd45a2310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.886490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a36c8-a2f7-4a70-85df-a74cd45a2310 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.887049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a36c8-a2f7-4a70-85df-a74cd45a2310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.887407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a36c8-a2f7-4a70-85df-a74cd45a2310 admin admin] PATH_INFO: `/v3/projects/cf540bbd04c041b0ad1028d72de46858/users/6afb2fd981ed44cbac9d6d82cf19f695/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.889902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.892285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.892715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.893057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] PATH_INFO: `/v3/projects/2a4143284e004df6bb036825f5450ac8/users/411081f991ee44429af5582c322420d1/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.895517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4143284e004df6bb036825f5450ac8, user_id=411081f991ee44429af5582c322420d1, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.899265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.906078 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a36c8-a2f7-4a70-85df-a74cd45a2310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf540bbd04c041b0ad1028d72de46858, user_id=6afb2fd981ed44cbac9d6d82cf19f695, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.909224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a36c8-a2f7-4a70-85df-a74cd45a2310 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:22.911076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 812/1645] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:22 2022] PUT /identity/v3/projects/2a4143284e004df6bb036825f5450ac8/users/411081f991ee44429af5582c322420d1/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:22.912490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:22.976664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb45-cf7c-44ab-aa83-da6608095ad7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:22.981263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00026724-f8ed-435d-9f53-db0f145c0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:22.982277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026724-f8ed-435d-9f53-db0f145c0231 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:22.982379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026724-f8ed-435d-9f53-db0f145c0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:22.982651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026724-f8ed-435d-9f53-db0f145c0231 admin admin] PATH_INFO: `/v3/projects/515070126baf4d0d938f1aaadfc08f4b/users/cc2582a25f8a466fb64cf2e5e506b9bc/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:22.995768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00026724-f8ed-435d-9f53-db0f145c0231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515070126baf4d0d938f1aaadfc08f4b, user_id=cc2582a25f8a466fb64cf2e5e506b9bc, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:22.998404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00026724-f8ed-435d-9f53-db0f145c0231 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:23.019739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 834/1646] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:22 2022] PUT /identity/v3/projects/cf540bbd04c041b0ad1028d72de46858/users/6afb2fd981ed44cbac9d6d82cf19f695/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:23.022524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13f00a-6835-4b3e-90bf-2b99f686eafc None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.022524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13f00a-6835-4b3e-90bf-2b99f686eafc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.022524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13f00a-6835-4b3e-90bf-2b99f686eafc None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.024022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 835/1647] 10.222.0.88 () {54 vars in 961 bytes} [Mon Jan 17 09:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:53:23.025079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cba5e-7f32-462a-a03e-9a3a8e002de9 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.025360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cba5e-7f32-462a-a03e-9a3a8e002de9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.025631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cba5e-7f32-462a-a03e-9a3a8e002de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.055169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-dd1cba5e-7f32-462a-a03e-9a3a8e002de9 None None] MFA Rules not processed for user `411081f991ee44429af5582c322420d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:23.055169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-dd1cba5e-7f32-462a-a03e-9a3a8e002de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:23.119721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 836/1648] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:23.121835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cba5e-7f32-462a-a03e-9a3a8e002de9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.133785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 813/1649] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:22 2022] PUT /identity/v3/projects/515070126baf4d0d938f1aaadfc08f4b/users/cc2582a25f8a466fb64cf2e5e506b9bc/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:23.137939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12135-982a-432a-8d09-bd28eb287643 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.138230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12135-982a-432a-8d09-bd28eb287643 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.138505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12135-982a-432a-8d09-bd28eb287643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.157081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-55c12135-982a-432a-8d09-bd28eb287643 None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:23.158345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-55c12135-982a-432a-8d09-bd28eb287643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:23.193699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cba5e-7f32-462a-a03e-9a3a8e002de9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.240750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 814/1650] 10.222.0.88 () {58 vars in 1058 bytes} [Mon Jan 17 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:23.241539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12135-982a-432a-8d09-bd28eb287643 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.263191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.263667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.263946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.265623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.265623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:23.266777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:23.281899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 837/1651] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:23.281899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.293080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92e89-be5b-466e-ae14-6931d45efadc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.299695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.300580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.300956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.301381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.302251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:23.304163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:23.316487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 838/1652] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:23.320492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12135-982a-432a-8d09-bd28eb287643 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.320931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.326047 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535a15-ce80-48a8-98cb-964867e1a897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.328802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535a15-ce80-48a8-98cb-964867e1a897 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.328802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535a15-ce80-48a8-98cb-964867e1a897 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.328802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535a15-ce80-48a8-98cb-964867e1a897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.337497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb892c-0851-440b-8de5-ff9157c37ed5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.344553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.345924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.346302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.347049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.407489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:23.409291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:23.429113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 839/1653] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:23.431088 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.441667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e4f7-17b1-4883-b22c-180e13971419 service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.446790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.447888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.448171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.448540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] PATH_INFO: `/v3/projects/cf540bbd04c041b0ad1028d72de46858/users/6afb2fd981ed44cbac9d6d82cf19f695/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.450046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe535a15-ce80-48a8-98cb-964867e1a897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:23.451176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf540bbd04c041b0ad1028d72de46858, user_id=6afb2fd981ed44cbac9d6d82cf19f695, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:23.455034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe535a15-ce80-48a8-98cb-964867e1a897 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:23.455160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:23.467112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 840/1654] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:23 2022] PUT /identity/v3/projects/cf540bbd04c041b0ad1028d72de46858/users/6afb2fd981ed44cbac9d6d82cf19f695/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:23.469190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.473750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 815/1655] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:23.478328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607176ca-80f7-4b92-b580-3af4184cecc4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.478619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607176ca-80f7-4b92-b580-3af4184cecc4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.478951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607176ca-80f7-4b92-b580-3af4184cecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.545406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-607176ca-80f7-4b92-b580-3af4184cecc4 None None] MFA Rules not processed for user `6afb2fd981ed44cbac9d6d82cf19f695`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:23.549845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-607176ca-80f7-4b92-b580-3af4184cecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:23.591672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8b48f-e7b6-4038-8ea6-68a0e0f293be admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.597687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a831fde-a032-41fe-b18f-0e978d10f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.598670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a831fde-a032-41fe-b18f-0e978d10f8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.599100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a831fde-a032-41fe-b18f-0e978d10f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.599584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a831fde-a032-41fe-b18f-0e978d10f8fb admin admin] PATH_INFO: `/v3/projects/515070126baf4d0d938f1aaadfc08f4b/users/cc2582a25f8a466fb64cf2e5e506b9bc/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.601840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a831fde-a032-41fe-b18f-0e978d10f8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=515070126baf4d0d938f1aaadfc08f4b, user_id=cc2582a25f8a466fb64cf2e5e506b9bc, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:23.605620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a831fde-a032-41fe-b18f-0e978d10f8fb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:23.636010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 841/1656] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:23 2022] PUT /identity/v3/projects/515070126baf4d0d938f1aaadfc08f4b/users/cc2582a25f8a466fb64cf2e5e506b9bc/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:23.639987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e61a32-5288-4762-ae79-d5a51b6b0c17 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.640484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e61a32-5288-4762-ae79-d5a51b6b0c17 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.641095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e61a32-5288-4762-ae79-d5a51b6b0c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.730483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e0e61a32-5288-4762-ae79-d5a51b6b0c17 None None] MFA Rules not processed for user `cc2582a25f8a466fb64cf2e5e506b9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:23.734279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e0e61a32-5288-4762-ae79-d5a51b6b0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:23.735841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 816/1657] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:23.751989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607176ca-80f7-4b92-b580-3af4184cecc4 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.867019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607176ca-80f7-4b92-b580-3af4184cecc4 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.890519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 842/1658] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:23.933418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.934422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.934962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.935516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:23.957426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e61a32-5288-4762-ae79-d5a51b6b0c17 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:23.972595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e61a32-5288-4762-ae79-d5a51b6b0c17 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:23.980638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e68e-2f2d-4ad6-8859-68e6e0c2d025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:23.981230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e68e-2f2d-4ad6-8859-68e6e0c2d025 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:23.981512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e68e-2f2d-4ad6-8859-68e6e0c2d025 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:23.981784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e68e-2f2d-4ad6-8859-68e6e0c2d025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.000361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384e68e-2f2d-4ad6-8859-68e6e0c2d025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:24.002227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384e68e-2f2d-4ad6-8859-68e6e0c2d025 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:24.023574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:24.025646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 843/1659] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:23 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:24.026046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:24.029321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66dff1-0e5c-42ab-803e-51d4071c0260 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.029937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66dff1-0e5c-42ab-803e-51d4071c0260 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.033002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66dff1-0e5c-42ab-803e-51d4071c0260 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.038880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 844/1660] 10.222.0.88 () {54 vars in 912 bytes} [Mon Jan 17 09:53:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:53:24.045681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c2c5-5462-4ba1-b29f-f381b0eb7296 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.045963 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c2c5-5462-4ba1-b29f-f381b0eb7296 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.046236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c2c5-5462-4ba1-b29f-f381b0eb7296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.050537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 817/1661] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:24.071033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6be5c2c5-5462-4ba1-b29f-f381b0eb7296 None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:24.072311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6be5c2c5-5462-4ba1-b29f-f381b0eb7296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:24.164257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 845/1662] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:24.180754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:24.182458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:24.282414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be358-a6ae-4bec-ad6b-7a70073987f6 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.282892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be358-a6ae-4bec-ad6b-7a70073987f6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.283276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be358-a6ae-4bec-ad6b-7a70073987f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.326642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-945be358-a6ae-4bec-ad6b-7a70073987f6 None None] MFA Rules not processed for user `f12d89fe1feb44c094e1321c41deac60`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:24.326642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-945be358-a6ae-4bec-ad6b-7a70073987f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:24.359710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9145c-5f0e-4e0e-b3de-9675bd104c9c service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:24.362854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:24.363516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.364044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.364044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.394483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:24.396196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:24.413061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 818/1663] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:24.414700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:24.428642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22210738-3b9b-4bf1-b5dd-3e1fab550635 service glance] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:24.433638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142ebe7-aeaf-4489-b131-8a86a0faa19d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:24.434934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142ebe7-aeaf-4489-b131-8a86a0faa19d service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.445662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142ebe7-aeaf-4489-b131-8a86a0faa19d service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.446242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142ebe7-aeaf-4489-b131-8a86a0faa19d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.486768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 846/1664] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:24.486768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945be358-a6ae-4bec-ad6b-7a70073987f6 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:24.502854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945be358-a6ae-4bec-ad6b-7a70073987f6 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:24.508826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:24.509654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.509811 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.510080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.553777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142ebe7-aeaf-4489-b131-8a86a0faa19d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:24.555273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142ebe7-aeaf-4489-b131-8a86a0faa19d service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:24.566547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 819/1665] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:24.568003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f31ba-41ba-4cde-8c4a-968726678cf0 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.568294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f31ba-41ba-4cde-8c4a-968726678cf0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.568771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f31ba-41ba-4cde-8c4a-968726678cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.589266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-730f31ba-41ba-4cde-8c4a-968726678cf0 None None] MFA Rules not processed for user `f12d89fe1feb44c094e1321c41deac60`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:24.593712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-730f31ba-41ba-4cde-8c4a-968726678cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:24.606154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 820/1666] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:24.631067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5b51-fa82-4c49-b1a3-6daabf8c04f9 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.631384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5b51-fa82-4c49-b1a3-6daabf8c04f9 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.631658 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5b51-fa82-4c49-b1a3-6daabf8c04f9 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.633849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 821/1667] 10.222.0.88 () {54 vars in 961 bytes} [Mon Jan 17 09:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:53:24.636422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:24.638006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:24.651079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a321-ddc5-4272-a454-9f2a1d6195a8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.657132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a321-ddc5-4272-a454-9f2a1d6195a8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.657132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a321-ddc5-4272-a454-9f2a1d6195a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.662932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 847/1668] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:24.710988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c894a321-ddc5-4272-a454-9f2a1d6195a8 None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:24.713183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c894a321-ddc5-4272-a454-9f2a1d6195a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:24.740409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 822/1669] 10.222.0.88 () {58 vars in 1058 bytes} [Mon Jan 17 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:24.748485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:24.785516 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70738-5a12-4895-927e-b4e75b918a52 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:24.796250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:24.796940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.797224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.797508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.812298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:24.816942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:24.841527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5041d-feca-451d-8d9f-2d57c921311f None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.841817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5041d-feca-451d-8d9f-2d57c921311f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.842115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5041d-feca-451d-8d9f-2d57c921311f None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.844929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 823/1670] 10.222.0.88 () {54 vars in 912 bytes} [Mon Jan 17 09:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 17 09:53:24.848837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 848/1671] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:24.850798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415413-95f5-42e7-9180-c66fa4b8d749 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:24.851189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415413-95f5-42e7-9180-c66fa4b8d749 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:24.851567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415413-95f5-42e7-9180-c66fa4b8d749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:24.911920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4b415413-95f5-42e7-9180-c66fa4b8d749 None None] MFA Rules not processed for user `4bc44cadca4c4ac3a3264de0a4641437`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:24.913579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4b415413-95f5-42e7-9180-c66fa4b8d749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:25.009076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 824/1672] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:25.020913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:25.031940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cefbf-cbac-4fcf-a0bf-a823fbecbbcd service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:25.037189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed056a-e252-4bdf-90ae-f9e05e444f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:25.038561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed056a-e252-4bdf-90ae-f9e05e444f45 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.039069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed056a-e252-4bdf-90ae-f9e05e444f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.039570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed056a-e252-4bdf-90ae-f9e05e444f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.049448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed056a-e252-4bdf-90ae-f9e05e444f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:25.051339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed056a-e252-4bdf-90ae-f9e05e444f45 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:25.069784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 849/1673] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:25.153157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56539e-a67d-4ca6-af47-f06b63bb3175 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.159338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56539e-a67d-4ca6-af47-f06b63bb3175 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.159338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56539e-a67d-4ca6-af47-f06b63bb3175 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.159338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 825/1674] 10.222.0.88 () {54 vars in 912 bytes} [Mon Jan 17 09:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:53:25.161960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22208759-e713-4ded-ae12-1bb2d4438aa4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.162246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22208759-e713-4ded-ae12-1bb2d4438aa4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.162519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22208759-e713-4ded-ae12-1bb2d4438aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.181790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-22208759-e713-4ded-ae12-1bb2d4438aa4 None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:25.183075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-22208759-e713-4ded-ae12-1bb2d4438aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:25.196382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 850/1675] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:25.208873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56539e-a67d-4ca6-af47-f06b63bb3175 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:25.228250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56539e-a67d-4ca6-af47-f06b63bb3175 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:25.232741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888324d3-e9a3-4fe8-9cc8-b2c8dfa33d79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:25.233625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888324d3-e9a3-4fe8-9cc8-b2c8dfa33d79 service glance] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.233981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888324d3-e9a3-4fe8-9cc8-b2c8dfa33d79 service glance] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.234329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888324d3-e9a3-4fe8-9cc8-b2c8dfa33d79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.258407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888324d3-e9a3-4fe8-9cc8-b2c8dfa33d79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:25.260620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888324d3-e9a3-4fe8-9cc8-b2c8dfa33d79 service glance] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:25.284969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 826/1676] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:25.335948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22208759-e713-4ded-ae12-1bb2d4438aa4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:25.515115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22208759-e713-4ded-ae12-1bb2d4438aa4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:25.515115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:25.516513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.517181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.517637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] PATH_INFO: `/v3/users/b7c6362c55bc4bb4bac0de7cc23dc9e6` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.519905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c6362c55bc4bb4bac0de7cc23dc9e6)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:25.522932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:25.650809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3904ce-b1ef-46c0-b6f8-7eab04fb07d1 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.651718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3904ce-b1ef-46c0-b6f8-7eab04fb07d1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.652653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3904ce-b1ef-46c0-b6f8-7eab04fb07d1 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.654647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 827/1677] 10.222.0.88 () {54 vars in 912 bytes} [Mon Jan 17 09:53:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:53:25.660743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2247d-fa95-4069-a461-1e1f3378f115 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.661113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2247d-fa95-4069-a461-1e1f3378f115 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.662533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2247d-fa95-4069-a461-1e1f3378f115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.684631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7ce2247d-fa95-4069-a461-1e1f3378f115 None None] MFA Rules not processed for user `4bc44cadca4c4ac3a3264de0a4641437`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:25.685930 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7ce2247d-fa95-4069-a461-1e1f3378f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:25.703878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 828/1678] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:25.710868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2247d-fa95-4069-a461-1e1f3378f115 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:25.720987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2247d-fa95-4069-a461-1e1f3378f115 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:25.725160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:25.725832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:25.726285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:25.726723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:25.735015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:25.737070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:25.747841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 829/1679] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:25.892694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:25.936401 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c6362c55bc4bb4bac0de7cc23dc9e6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:25.950062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c6362c55bc4bb4bac0de7cc23dc9e6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:26.025084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c6362c55bc4bb4bac0de7cc23dc9e6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:26.025733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c6362c55bc4bb4bac0de7cc23dc9e6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:26.045018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5a147fad-2135-4299-9975-94d3afc4ede5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c6362c55bc4bb4bac0de7cc23dc9e6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:26.055693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352f4b-82ff-4e6e-aa0c-c0f6cbbf2851 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:26.059123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 851/1680] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:25 2022] DELETE /identity/v3/users/b7c6362c55bc4bb4bac0de7cc23dc9e6 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:26.065617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:26.065908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:26.066186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:26.072807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:26.073612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:26.073933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:26.074174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:26.083788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:26.109871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:26.110606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:26.111844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:26.113570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:26.139132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 830/1681] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:26.226574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 852/1682] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:26.242963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:26.244399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:26.263908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930df3-e551-4699-ae90-05f6ece9d5a6 service placement] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:26.389054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:26.389732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:26.394847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:26.394847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:26.430801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:26.433377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:26.466461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 831/1683] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:27.938576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:27.940917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:27.980982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee904250-323f-4289-b178-74d1f4dae6c0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:28.000362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:28.001415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:28.001716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:28.002149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] PATH_INFO: `/v3/projects/d5406dddbd4c47ca999f780e05d13368` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:28.003600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5406dddbd4c47ca999f780e05d13368)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:28.005393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: WARNING py.warnings [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:53:28.005393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: warnings.warn(msg) Jan 17 09:53:28.005393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: Jan 17 09:53:28.007221 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:28.159464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5406dddbd4c47ca999f780e05d13368', 'request_id': 'req-2935efa9-11e5-497f-bb42-7af35df3f88b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.176715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5406dddbd4c47ca999f780e05d13368', 'request_id': 'req-2935efa9-11e5-497f-bb42-7af35df3f88b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.259696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5406dddbd4c47ca999f780e05d13368', 'request_id': 'req-2935efa9-11e5-497f-bb42-7af35df3f88b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.309503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] The token cache is being invalidate because project d5406dddbd4c47ca999f780e05d13368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:28.310044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.311145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.312975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 853/1684] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:27 2022] DELETE /identity/v3/projects/d5406dddbd4c47ca999f780e05d13368 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:28.317493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:28.335753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96475a55-7f1b-48c1-aa41-77df60429604 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:28.446297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:28.447659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:28.448407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:28.449105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] PATH_INFO: `/v3/users/411081f991ee44429af5582c322420d1` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:28.451052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=411081f991ee44429af5582c322420d1)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:28.452579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: WARNING py.warnings [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 17 09:53:28.452579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: warnings.warn(msg) Jan 17 09:53:28.452579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: Jan 17 09:53:28.463771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:28.814521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411081f991ee44429af5582c322420d1'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.843042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411081f991ee44429af5582c322420d1'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.844175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411081f991ee44429af5582c322420d1'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:28.956828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411081f991ee44429af5582c322420d1'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:29.018389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6fa771f3-6d96-42bf-988d-dd1e938dc8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411081f991ee44429af5582c322420d1'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:29.028001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 832/1685] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:28 2022] DELETE /identity/v3/users/411081f991ee44429af5582c322420d1 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:30.218306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:30.220140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:30.240222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935efa9-11e5-497f-bb42-7af35df3f88b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:30.409236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:30.410135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:30.410417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:30.416127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] PATH_INFO: `/v3/projects/2a4143284e004df6bb036825f5450ac8` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:30.421276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4143284e004df6bb036825f5450ac8)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:30.429955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:30.624814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4143284e004df6bb036825f5450ac8', 'request_id': 'req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:30.641383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4143284e004df6bb036825f5450ac8', 'request_id': 'req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:30.733682 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4143284e004df6bb036825f5450ac8', 'request_id': 'req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:30.754126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] The token cache is being invalidate because project 2a4143284e004df6bb036825f5450ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:30.754427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:30.755665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47c3d10b-7c03-4d5d-be62-bc9c9db4ad27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:30.759566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 854/1686] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:30 2022] DELETE /identity/v3/projects/2a4143284e004df6bb036825f5450ac8 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:30.765100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79474289-03a8-47f0-ab8e-e2665f77df17 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:30.765637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79474289-03a8-47f0-ab8e-e2665f77df17 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:30.765720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79474289-03a8-47f0-ab8e-e2665f77df17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:30.805585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-79474289-03a8-47f0-ab8e-e2665f77df17 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:30.814101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-79474289-03a8-47f0-ab8e-e2665f77df17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:30.991523 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 833/1687] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:30.998540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d0243-534b-447a-9e4b-c7875914902f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:30.999394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d0243-534b-447a-9e4b-c7875914902f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:30.999882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d0243-534b-447a-9e4b-c7875914902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:31.038086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1c9d0243-534b-447a-9e4b-c7875914902f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:31.041049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1c9d0243-534b-447a-9e4b-c7875914902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:31.096146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 855/1688] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:31.100262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79474289-03a8-47f0-ab8e-e2665f77df17 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:31.123457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79474289-03a8-47f0-ab8e-e2665f77df17 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:31.145974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b527044-bdc3-4d40-abf6-36cefbfe077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:31.148408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b527044-bdc3-4d40-abf6-36cefbfe077a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:31.148752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b527044-bdc3-4d40-abf6-36cefbfe077a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:31.149171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b527044-bdc3-4d40-abf6-36cefbfe077a admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:31.149944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b527044-bdc3-4d40-abf6-36cefbfe077a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:31.150256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b527044-bdc3-4d40-abf6-36cefbfe077a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:31.153335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b527044-bdc3-4d40-abf6-36cefbfe077a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:31.178805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 834/1689] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:31.180615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d0243-534b-447a-9e4b-c7875914902f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:31.196173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d0243-534b-447a-9e4b-c7875914902f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:31.210767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:31.215382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:31.215382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:31.215668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:31.216456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:31.222005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:31.315389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbffe2-c4e0-4eed-841b-4dfef96f8092 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:31.315752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbffe2-c4e0-4eed-841b-4dfef96f8092 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:31.316016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbffe2-c4e0-4eed-841b-4dfef96f8092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:31.348174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f7cbffe2-c4e0-4eed-841b-4dfef96f8092 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:31.350246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f7cbffe2-c4e0-4eed-841b-4dfef96f8092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:31.466944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 856/1690] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:31 2022] POST /identity/v3/projects => generated 369 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:31.475437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:31.482366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 835/1691] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:53:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:31.644082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1bc10-181c-4ba9-b626-c41928654b9a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:31.659954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:31.661076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:31.661581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:31.662076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:31.663023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:31.667755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:31.949739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 857/1692] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:31 2022] POST /identity/v3/users => generated 285 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:31.951405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbffe2-c4e0-4eed-841b-4dfef96f8092 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:31.965728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbffe2-c4e0-4eed-841b-4dfef96f8092 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:31.971546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:31.972537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:31.973221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:31.973636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:31.974502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:31.976406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:31.992800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:32.009634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb67df-5351-4bd5-824f-e9222d3661c1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:32.020334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 836/1693] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:32.022828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:32.022985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:32.024674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:32.026031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:32.026559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:32.027160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:32.027799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:32.030344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:32.071126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 858/1694] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:32.072202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:32.090499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ec18-34de-465d-94b8-19cacd769f41 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:32.103520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a090b74-8739-4acd-8333-ff58e3f0a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:32.104396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090b74-8739-4acd-8333-ff58e3f0a64d admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:32.104650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090b74-8739-4acd-8333-ff58e3f0a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:32.104924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090b74-8739-4acd-8333-ff58e3f0a64d admin admin] PATH_INFO: `/v3/projects/19d4ef272fde4f3498c1db1147dde3f9/users/33a4eca0c7a049f58119a6e99c4502e7/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:32.142568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a090b74-8739-4acd-8333-ff58e3f0a64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d4ef272fde4f3498c1db1147dde3f9, user_id=33a4eca0c7a049f58119a6e99c4502e7, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:32.145383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a090b74-8739-4acd-8333-ff58e3f0a64d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:32.164938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063fcb-c2b4-4139-8d16-736695fefded admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:32.182302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:32.184720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:32.186200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:32.186496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:32.226846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 859/1695] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:32 2022] PUT /identity/v3/projects/19d4ef272fde4f3498c1db1147dde3f9/users/33a4eca0c7a049f58119a6e99c4502e7/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:32.238260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a25fc2-9bc3-46c1-a960-a4ea356a8fbd None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:32.244587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a25fc2-9bc3-46c1-a960-a4ea356a8fbd None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:32.244587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a25fc2-9bc3-46c1-a960-a4ea356a8fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:32.290190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:32.292963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:32.305978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a3a25fc2-9bc3-46c1-a960-a4ea356a8fbd None None] MFA Rules not processed for user `33a4eca0c7a049f58119a6e99c4502e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:32.307282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a3a25fc2-9bc3-46c1-a960-a4ea356a8fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:32.310642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 837/1696] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:53:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:53:32.470154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 860/1697] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:32.475981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:32.522854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02881ab3-61e2-48f4-ac7e-2073ad646126 service swift] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:32.758393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:32.759292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:32.760092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:32.760092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:32.760967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:32.763041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:32.908851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 838/1698] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:32 2022] POST /identity/v3/projects => generated 369 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:32.910991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a25fc2-9bc3-46c1-a960-a4ea356a8fbd None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:32.935062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a25fc2-9bc3-46c1-a960-a4ea356a8fbd None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:33.120690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:33.121372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:33.121654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:33.122543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:33.122664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:33.124948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:33.245648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 861/1699] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:32 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:53:33.249920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:33.269094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538d480-05a9-4ba5-ad72-4442336227a1 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:33.293966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:33.298362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:33.299956 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:33.300317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:33.304069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:33.307211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:33.342771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 839/1700] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:33.346823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:33.360645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527113ef-95e6-4786-9888-77819a576dec admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:33.372809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:33.375487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:33.376101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:33.376595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] PATH_INFO: `/v3/projects/1367bd3519c84ca59504ac9da30d470f/users/c514369da83a43f29cf824338ec63f7f/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:33.397394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1367bd3519c84ca59504ac9da30d470f, user_id=c514369da83a43f29cf824338ec63f7f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:33.400817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:33.485687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 862/1701] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:33 2022] PUT /identity/v3/projects/1367bd3519c84ca59504ac9da30d470f/users/c514369da83a43f29cf824338ec63f7f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:53:33.491828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:33.510193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdf51a-cc6c-4781-afde-25c02e5fddbd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:33.645722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bab637-c658-472e-82cc-61ec7a00ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:33.646421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab637-c658-472e-82cc-61ec7a00ec0f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:33.646696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab637-c658-472e-82cc-61ec7a00ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:33.646999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab637-c658-472e-82cc-61ec7a00ec0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:33.647815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bab637-c658-472e-82cc-61ec7a00ec0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:33.651268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bab637-c658-472e-82cc-61ec7a00ec0f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:33.682491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 840/1702] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:33.725970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:33.725970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57d17-716a-44c2-b886-fa824d1b324a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:33.725970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:33.725970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:33.726748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:33.726748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] PATH_INFO: `/v3/projects/1367bd3519c84ca59504ac9da30d470f/users/c514369da83a43f29cf824338ec63f7f/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:33.726748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1367bd3519c84ca59504ac9da30d470f, user_id=c514369da83a43f29cf824338ec63f7f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:33.750054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:33.770158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 863/1703] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:33 2022] PUT /identity/v3/projects/1367bd3519c84ca59504ac9da30d470f/users/c514369da83a43f29cf824338ec63f7f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:33.780461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ef0b9-4eda-44be-a0e4-48ff04916f7c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:33.780746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ef0b9-4eda-44be-a0e4-48ff04916f7c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:33.781028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ef0b9-4eda-44be-a0e4-48ff04916f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:33.823027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-cb1ef0b9-4eda-44be-a0e4-48ff04916f7c None None] MFA Rules not processed for user `c514369da83a43f29cf824338ec63f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:33.824120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cb1ef0b9-4eda-44be-a0e4-48ff04916f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:34.002410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 841/1704] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:34.019320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:34.021570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:34.178508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0138b-6910-443b-ba79-35e9e5949d36 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:34.187245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:34.188127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:34.189640 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:34.189922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:34.220041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:34.222657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:34.237483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 864/1705] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:36.510964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7518-94ea-428c-a899-0318ea94af11 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:36.510964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7518-94ea-428c-a899-0318ea94af11 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:36.510964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7518-94ea-428c-a899-0318ea94af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:36.548614 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e69a7518-94ea-428c-a899-0318ea94af11 None None] MFA Rules not processed for user `15915c83afbe4addbcdd2ede00aa3d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:36.550062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e69a7518-94ea-428c-a899-0318ea94af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:36.679471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 842/1706] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:36.698183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:36.703372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:36.871994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41560-7c5a-45af-acd2-60650cb406b4 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:36.879575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1baa6-4857-4fc7-872c-5a8937f00034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:36.880753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1baa6-4857-4fc7-872c-5a8937f00034 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:36.881039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1baa6-4857-4fc7-872c-5a8937f00034 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:36.881390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1baa6-4857-4fc7-872c-5a8937f00034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:36.896779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1baa6-4857-4fc7-872c-5a8937f00034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:36.900749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1baa6-4857-4fc7-872c-5a8937f00034 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:36.915231 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 865/1707] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:37.445733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04013ca-7499-4003-9b4a-bd2977ba5b5d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:37.446962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04013ca-7499-4003-9b4a-bd2977ba5b5d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:37.447389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04013ca-7499-4003-9b4a-bd2977ba5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:37.484380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f04013ca-7499-4003-9b4a-bd2977ba5b5d None None] MFA Rules not processed for user `8590cb39fdcb499ab21077e47371822e`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:37.485720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f04013ca-7499-4003-9b4a-bd2977ba5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:37.691520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:37.691810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:37.694147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:37.698342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 843/1708] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:37.702506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771fe80-3b5c-4829-896a-1bdf6e23d056 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:37.702826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771fe80-3b5c-4829-896a-1bdf6e23d056 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:37.703103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771fe80-3b5c-4829-896a-1bdf6e23d056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:37.787559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f771fe80-3b5c-4829-896a-1bdf6e23d056 None None] MFA Rules not processed for user `8590cb39fdcb499ab21077e47371822e`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:37.791507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f771fe80-3b5c-4829-896a-1bdf6e23d056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:37.841305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 844/1709] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:37.866976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] MFA Rules not processed for user `f230cf14688842a28afa95ad403436b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:37.868499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:38.009085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:38.009745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:38.010473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:38.085134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] MFA Rules not processed for user `4bc44cadca4c4ac3a3264de0a4641437`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:38.093872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:38.104880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 866/1710] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:38.230831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 845/1711] 10.222.0.94 () {58 vars in 1015 bytes} [Mon Jan 17 09:53:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:38.255829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:38.258093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:38.300061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe12ed8-a45a-42dc-9a04-dda6d1f2600d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:38.315145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:38.316009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:38.316427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:38.316967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:38.318448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:38.320011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:38.362405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8b9a6-a255-43ce-8bbc-b1d230110332 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:38.375244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:38.379082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:38.380417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:38.381233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:38.381632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:38.382036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:38.408656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:38.410374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:38.410800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 867/1712] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:38.430807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 846/1713] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:38.476020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:38.487547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:38.537746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:38.561987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf542c-4f09-4053-a2e2-2474de12fbb5 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:38.564353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ceec-78d2-4a33-84f5-cd1c9db6889a service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:38.589124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:38.589952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:38.600438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe78663-f038-4c2e-a68b-74ea959ee0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:38.601350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78663-f038-4c2e-a68b-74ea959ee0a8 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:38.601791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78663-f038-4c2e-a68b-74ea959ee0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:38.602354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78663-f038-4c2e-a68b-74ea959ee0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:38.602913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:38.603209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:38.625169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78663-f038-4c2e-a68b-74ea959ee0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:38.635383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:38.635965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78663-f038-4c2e-a68b-74ea959ee0a8 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:38.645283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:38.671485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 847/1714] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:38.692259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 868/1715] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:40.538123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:40.725386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb98d53-ce2d-44c3-86c7-6c912a398b55 service nova] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:40.771609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:40.772918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:40.773457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:40.773907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] PATH_INFO: `/v3/users/33a4eca0c7a049f58119a6e99c4502e7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:40.776292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a4eca0c7a049f58119a6e99c4502e7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:40.779298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:41.040826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a4eca0c7a049f58119a6e99c4502e7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:41.079589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a4eca0c7a049f58119a6e99c4502e7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:41.081160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a4eca0c7a049f58119a6e99c4502e7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:41.215917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a4eca0c7a049f58119a6e99c4502e7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:41.246371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b5803ea0-92bc-4d2e-9080-9c98e35ba443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a4eca0c7a049f58119a6e99c4502e7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:41.246524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e007f1-44db-4cd4-b407-02fdb5e5b175 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:41.247023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e007f1-44db-4cd4-b407-02fdb5e5b175 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:41.247097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e007f1-44db-4cd4-b407-02fdb5e5b175 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:41.249665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 869/1716] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:53:41.264342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 848/1717] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:40 2022] DELETE /identity/v3/users/33a4eca0c7a049f58119a6e99c4502e7 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:41.272074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:41.273578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:41.274295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:41.317361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:41.318645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:41.402414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0859b-0ab6-432a-a66a-9a32991bb16a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:41.402769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0859b-0ab6-432a-a66a-9a32991bb16a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:41.403063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0859b-0ab6-432a-a66a-9a32991bb16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:41.458102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f5a0859b-0ab6-432a-a66a-9a32991bb16a None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:41.465485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f5a0859b-0ab6-432a-a66a-9a32991bb16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:41.587047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 870/1718] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:41.608379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:41.624412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:41.717578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 849/1719] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:53:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:41.853940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b938aba-f606-4e1d-a002-714cc35fa8ed None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:41.868719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:41.870504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:41.870823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:41.871103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:41.888875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f2cb-fa5a-4da7-ab4d-f6a5a12fc5ad None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:41.889165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f2cb-fa5a-4da7-ab4d-f6a5a12fc5ad None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:41.889444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f2cb-fa5a-4da7-ab4d-f6a5a12fc5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:41.929265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:41.939338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:41.954566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-42d8f2cb-fa5a-4da7-ab4d-f6a5a12fc5ad None None] MFA Rules not processed for user `8590cb39fdcb499ab21077e47371822e`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:41.958464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-42d8f2cb-fa5a-4da7-ab4d-f6a5a12fc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:41.978812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 871/1720] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:42.106245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 850/1721] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:42.503207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:42.505683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:42.545695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36f435-fc36-42d0-9841-6ad54390aaf9 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:42.567624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83969f35-9564-4e38-b922-49069d97d4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:42.569036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969f35-9564-4e38-b922-49069d97d4de service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:42.569549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969f35-9564-4e38-b922-49069d97d4de service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:42.570541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83969f35-9564-4e38-b922-49069d97d4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:42.599365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83969f35-9564-4e38-b922-49069d97d4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:42.601294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83969f35-9564-4e38-b922-49069d97d4de service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:42.679564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 872/1722] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:43.210250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40296-dcb8-4021-aaa3-4e1f6f86fcf3 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:43.211696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40296-dcb8-4021-aaa3-4e1f6f86fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:43.220707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40296-dcb8-4021-aaa3-4e1f6f86fcf3 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:43.220707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 851/1723] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:53:43.429557 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:43.429846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:43.430357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:43.486271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:43.487639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:43.543768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 873/1724] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:53:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:44.409867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40296-dcb8-4021-aaa3-4e1f6f86fcf3 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:44.446549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40296-dcb8-4021-aaa3-4e1f6f86fcf3 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:44.496485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:44.503796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:44.504011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:44.505048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:44.505333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:44.507705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:44.543610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0460789-77f6-4539-8a4e-7b3527c99012 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:44.546414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:44.553422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:44.575169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:44.579430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:44.579666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:44.579945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] PATH_INFO: `/v3/users/a28592c30b54403fa2c3236c9aeec804` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:44.587648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28592c30b54403fa2c3236c9aeec804)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:44.595835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:44.607172 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 852/1725] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:45.023223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28592c30b54403fa2c3236c9aeec804'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:45.045806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28592c30b54403fa2c3236c9aeec804'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:45.156241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28592c30b54403fa2c3236c9aeec804'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:45.159162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28592c30b54403fa2c3236c9aeec804'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:45.171714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:45.173723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:45.177385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c8a60e86-d7b6-4ec9-9845-1c3e1ae3ac7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28592c30b54403fa2c3236c9aeec804'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:45.185040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 874/1726] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:44 2022] DELETE /identity/v3/users/a28592c30b54403fa2c3236c9aeec804 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:45.191520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908983-fe89-4205-976f-da671855affe None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:45.192092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908983-fe89-4205-976f-da671855affe None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:45.192683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908983-fe89-4205-976f-da671855affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:45.202683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952460b-8215-4e51-bdee-8aac4312bfbe service nova] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:45.222846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-da908983-fe89-4205-976f-da671855affe None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:45.225643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-da908983-fe89-4205-976f-da671855affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:45.319212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:45.320135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:45.320448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:45.320787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] PATH_INFO: `/v3/projects/19d4ef272fde4f3498c1db1147dde3f9` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:45.324077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d4ef272fde4f3498c1db1147dde3f9)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:45.328151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:45.376916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 875/1727] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:45.504506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908983-fe89-4205-976f-da671855affe None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:45.506008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-da908983-fe89-4205-976f-da671855affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:45.561852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d4ef272fde4f3498c1db1147dde3f9', 'request_id': 'req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:45.580621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d4ef272fde4f3498c1db1147dde3f9', 'request_id': 'req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:45.713356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908983-fe89-4205-976f-da671855affe None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:45.854024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:45.856156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:45.856600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:45.857041 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:46.021107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:46.024620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:46.049484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 876/1728] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:46.596724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d4ef272fde4f3498c1db1147dde3f9', 'request_id': 'req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:46.621616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] The token cache is being invalidate because project 19d4ef272fde4f3498c1db1147dde3f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:46.621907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:46.622946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e2c5ecd4-bb74-4e8b-894f-8a7b46e959ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:46.632316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 853/1729] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:45 2022] DELETE /identity/v3/projects/19d4ef272fde4f3498c1db1147dde3f9 => generated 0 bytes in 1462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:46.636251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:46.640562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:46.679877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99d532-bc91-4743-a330-2380dac8d1e6 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:46.699818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:46.700621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:46.700878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:46.701319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] PATH_INFO: `/v3/users/c514369da83a43f29cf824338ec63f7f` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:46.704347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c514369da83a43f29cf824338ec63f7f)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:46.708775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:47.015916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c514369da83a43f29cf824338ec63f7f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:47.041165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c514369da83a43f29cf824338ec63f7f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:47.148235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c514369da83a43f29cf824338ec63f7f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:47.148759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c514369da83a43f29cf824338ec63f7f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:47.169752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c514369da83a43f29cf824338ec63f7f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:47.180493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 877/1730] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:46 2022] DELETE /identity/v3/users/c514369da83a43f29cf824338ec63f7f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:48.294344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:48.295185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:48.295657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:48.333458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] MFA Rules not processed for user `15915c83afbe4addbcdd2ede00aa3d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:48.333458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:48.483307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:48.489489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:48.598196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 854/1731] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:48.647717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:48.649419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:48.801689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d051a-18d5-4c4f-a439-10ffd2872c14 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:48.831616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:48.833146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:48.834180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:48.834982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] PATH_INFO: `/v3/projects/55080e7eac8749b88c9b6cad42862b58` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:48.838968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55080e7eac8749b88c9b6cad42862b58)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:48.843159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:48.891885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780b4c-4e86-4dba-85bd-e693c4bf7f78 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:48.897785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:48.910804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:48.911218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:48.911512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] PATH_INFO: `/v3/projects/1367bd3519c84ca59504ac9da30d470f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:48.913303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1367bd3519c84ca59504ac9da30d470f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:48.917625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:49.051836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55080e7eac8749b88c9b6cad42862b58', 'request_id': 'req-a2720bc0-901d-4ed0-9c33-ee04b385a892'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.066547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55080e7eac8749b88c9b6cad42862b58', 'request_id': 'req-a2720bc0-901d-4ed0-9c33-ee04b385a892'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.160048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1367bd3519c84ca59504ac9da30d470f', 'request_id': 'req-15dce98a-2d1d-41dd-8f93-364a971404e8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.175554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1367bd3519c84ca59504ac9da30d470f', 'request_id': 'req-15dce98a-2d1d-41dd-8f93-364a971404e8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.196934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55080e7eac8749b88c9b6cad42862b58', 'request_id': 'req-a2720bc0-901d-4ed0-9c33-ee04b385a892'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.209847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] The token cache is being invalidate because project 55080e7eac8749b88c9b6cad42862b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:49.210437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.211163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.215943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 878/1732] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:48 2022] DELETE /identity/v3/projects/55080e7eac8749b88c9b6cad42862b58 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:49.217107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:49.220055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:49.338797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1367bd3519c84ca59504ac9da30d470f', 'request_id': 'req-15dce98a-2d1d-41dd-8f93-364a971404e8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.362750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] The token cache is being invalidate because project 1367bd3519c84ca59504ac9da30d470f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:49.363356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.364916 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-15dce98a-2d1d-41dd-8f93-364a971404e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.375280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 855/1733] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:48 2022] DELETE /identity/v3/projects/1367bd3519c84ca59504ac9da30d470f => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:53:49.381404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288f20b-2476-440a-9b65-240c0d2efec3 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:49.383172 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288f20b-2476-440a-9b65-240c0d2efec3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:49.383742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288f20b-2476-440a-9b65-240c0d2efec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:49.388293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2720bc0-901d-4ed0-9c33-ee04b385a892 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:49.425900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3288f20b-2476-440a-9b65-240c0d2efec3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:49.427513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3288f20b-2476-440a-9b65-240c0d2efec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:49.557073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:49.558610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:49.559160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:49.559630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] PATH_INFO: `/v3/users/6afb2fd981ed44cbac9d6d82cf19f695` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:49.561345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afb2fd981ed44cbac9d6d82cf19f695)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:49.563794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:49.592595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 856/1734] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:49.594208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292eb4-bc8a-4812-9958-22f879b490b1 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:49.594496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292eb4-bc8a-4812-9958-22f879b490b1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:49.598400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292eb4-bc8a-4812-9958-22f879b490b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:49.656408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-72292eb4-bc8a-4812-9958-22f879b490b1 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:49.658184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-72292eb4-bc8a-4812-9958-22f879b490b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:49.681553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 857/1735] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:49.686392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292eb4-bc8a-4812-9958-22f879b490b1 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:49.694678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292eb4-bc8a-4812-9958-22f879b490b1 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:49.700213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:49.701186 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:49.701963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:49.702384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:49.703997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:49.704454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:49.706207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:49.725859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 858/1736] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:53:49.727215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:49.743470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3717-6cc3-4f91-a55b-d7a0064fe22b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:49.757798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:49.758485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:49.758807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:49.759114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:49.759840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:49.761759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:49.852832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afb2fd981ed44cbac9d6d82cf19f695'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.868690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afb2fd981ed44cbac9d6d82cf19f695'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.953270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 859/1737] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:49 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:49.954260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:49.976566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afb2fd981ed44cbac9d6d82cf19f695'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:49.977300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afb2fd981ed44cbac9d6d82cf19f695'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:50.006981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0501acef-1438-4e51-9bae-b61bb4272357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afb2fd981ed44cbac9d6d82cf19f695'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:50.018009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 879/1738] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:49 2022] DELETE /identity/v3/users/6afb2fd981ed44cbac9d6d82cf19f695 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:50.158138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcbb0-c24f-41ca-ad15-c541b96dbfaf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:50.299620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:50.300404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:50.300743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:50.301073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:50.301855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:50.303853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:50.459003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be828c-f734-47bc-86d8-c4e7ffd31715 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:50.459517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be828c-f734-47bc-86d8-c4e7ffd31715 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:50.462479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be828c-f734-47bc-86d8-c4e7ffd31715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:50.472566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 860/1739] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:49 2022] POST /identity/v3/users => generated 294 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:50.477813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:50.488313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:50.516180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-14be828c-f734-47bc-86d8-c4e7ffd31715 None None] MFA Rules not processed for user `f230cf14688842a28afa95ad403436b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:50.517690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-14be828c-f734-47bc-86d8-c4e7ffd31715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:50.523473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329b3ae-2a51-4f15-a3d6-28e97e3cbdaf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:50.538100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:50.539508 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:50.539946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:50.540364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:50.541582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:50.543282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:50.577627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 861/1740] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:50.580108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:50.617402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa352d54-ead1-4ef9-a939-65c8816c4b84 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:50.622782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 880/1741] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:50.633168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41bfca-12b2-45fc-8746-e6c56dc3304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:50.637960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41bfca-12b2-45fc-8746-e6c56dc3304d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:50.639987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41bfca-12b2-45fc-8746-e6c56dc3304d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:50.645384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41bfca-12b2-45fc-8746-e6c56dc3304d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:50.647017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41bfca-12b2-45fc-8746-e6c56dc3304d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:50.653439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41bfca-12b2-45fc-8746-e6c56dc3304d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:50.680939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 862/1742] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:50.684795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be828c-f734-47bc-86d8-c4e7ffd31715 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:50.699993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be828c-f734-47bc-86d8-c4e7ffd31715 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:50.706422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:50.708479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:50.709050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:50.709528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] PATH_INFO: `/v3/projects/b02bf989a2c84864b9f0bd1256bd628b/users/e17c5b28ca9d4ce9bf4e0587bda1b0d0/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:50.727693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02bf989a2c84864b9f0bd1256bd628b, user_id=e17c5b28ca9d4ce9bf4e0587bda1b0d0, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:50.730637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:50.914200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 881/1743] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:50 2022] PUT /identity/v3/projects/b02bf989a2c84864b9f0bd1256bd628b/users/e17c5b28ca9d4ce9bf4e0587bda1b0d0/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:53:50.925005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255437-98a6-45ea-ac4a-d7ec08b6cf91 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:50.925309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255437-98a6-45ea-ac4a-d7ec08b6cf91 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:50.925590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255437-98a6-45ea-ac4a-d7ec08b6cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:50.955625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c0255437-98a6-45ea-ac4a-d7ec08b6cf91 None None] MFA Rules not processed for user `e17c5b28ca9d4ce9bf4e0587bda1b0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:50.956859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c0255437-98a6-45ea-ac4a-d7ec08b6cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:51.082566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 863/1744] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:51.087338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:51.186390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f55e0-b0e8-40db-876a-687e79bee946 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:51.191377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:51.192035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:51.192504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:51.192941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:51.193686 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:51.195575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:51.330067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 882/1745] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:51 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:51.333986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255437-98a6-45ea-ac4a-d7ec08b6cf91 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:51.344090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:51.346037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:51.355263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255437-98a6-45ea-ac4a-d7ec08b6cf91 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:51.469433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020d420-a143-4661-9b7d-12f2ab807c20 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:51.471532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:51.477335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:51.478130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:51.479665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:51.480236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] PATH_INFO: `/v3/projects/cf540bbd04c041b0ad1028d72de46858` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:51.482422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf540bbd04c041b0ad1028d72de46858)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:51.484606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:51.485143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:51.485576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:51.485715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:51.488308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:51.492756 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:51.647623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 864/1746] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:51 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:51.652267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:51.667934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1be541-7305-4dbe-9730-baa434cc70ba admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:51.683981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:51.684665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:51.684945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:51.689860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:51.690988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:51.696920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:51.709521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf540bbd04c041b0ad1028d72de46858', 'request_id': 'req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:51.717820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf540bbd04c041b0ad1028d72de46858', 'request_id': 'req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:51.771201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 865/1747] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:53:51.772286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:51.802112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072d77-5a78-4b59-8627-60a60b1368a5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:51.834931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf540bbd04c041b0ad1028d72de46858', 'request_id': 'req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:51.852053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] The token cache is being invalidate because project cf540bbd04c041b0ad1028d72de46858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:51.852732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:51.854485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e0f51dde-fada-40ba-ad59-e3daaeb7e3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:51.871146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 883/1748] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:51 2022] DELETE /identity/v3/projects/cf540bbd04c041b0ad1028d72de46858 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:51.877468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052fc5b-1076-4107-b267-85aad3290c9e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:51.878073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052fc5b-1076-4107-b267-85aad3290c9e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:51.878507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052fc5b-1076-4107-b267-85aad3290c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:51.925688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6052fc5b-1076-4107-b267-85aad3290c9e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:51.929080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6052fc5b-1076-4107-b267-85aad3290c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:51.951919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:51.952128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:51.952416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:51.952690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:51.963854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:51.969941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.014142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 866/1749] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:52.085239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 884/1750] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:52.091030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.093056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:52.093584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b415-1087-4ce1-8f31-8a3f2a0fafac None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.094390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b415-1087-4ce1-8f31-8a3f2a0fafac None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.094673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b415-1087-4ce1-8f31-8a3f2a0fafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.106205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208d20-b937-47ef-8f6f-0530610a2160 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.112774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c22d1-dbf4-4cd8-b3e3-163c012e0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.112774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c22d1-dbf4-4cd8-b3e3-163c012e0b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.112985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c22d1-dbf4-4cd8-b3e3-163c012e0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.113214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c22d1-dbf4-4cd8-b3e3-163c012e0b49 admin admin] PATH_INFO: `/v3/projects/92b952c7d1c1417993cba24929dc4509/users/b6a4cf1a093b40458b16be5ac55ef3e9/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.113801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2049b415-1087-4ce1-8f31-8a3f2a0fafac None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:52.115046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2049b415-1087-4ce1-8f31-8a3f2a0fafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:52.123843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 885/1751] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:52.128330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b415-1087-4ce1-8f31-8a3f2a0fafac None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.132650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c22d1-dbf4-4cd8-b3e3-163c012e0b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b952c7d1c1417993cba24929dc4509, user_id=b6a4cf1a093b40458b16be5ac55ef3e9, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.135867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c22d1-dbf4-4cd8-b3e3-163c012e0b49 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.141510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b415-1087-4ce1-8f31-8a3f2a0fafac None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.148096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.148683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.148990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.149284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.150029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:53:52.150337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.152480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.170770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 886/1752] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:53:52.173463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.183634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5a540-9207-4350-8dab-e9f4c395c499 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.188269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.188922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.189257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.189540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.190245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.192576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.399506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 887/1753] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:52 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:53:52.400665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.413679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 867/1754] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:52 2022] PUT /identity/v3/projects/92b952c7d1c1417993cba24929dc4509/users/b6a4cf1a093b40458b16be5ac55ef3e9/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:52.424069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a68c1-ade4-4eb8-b41f-548d842918d8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.425815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a68c1-ade4-4eb8-b41f-548d842918d8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.437476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a68c1-ade4-4eb8-b41f-548d842918d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.486104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-0a4a68c1-ade4-4eb8-b41f-548d842918d8 None None] MFA Rules not processed for user `b6a4cf1a093b40458b16be5ac55ef3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:52.488056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0a4a68c1-ade4-4eb8-b41f-548d842918d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:52.497429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539128cc-6b42-4bf8-9eae-7a295a9c0ea0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.517643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.517643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.517643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.517643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.517972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.518446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.615174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 868/1755] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:52.616666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a68c1-ade4-4eb8-b41f-548d842918d8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.630014 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a68c1-ade4-4eb8-b41f-548d842918d8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.649274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.650043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.650310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.650623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.651932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.653883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.667826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 888/1756] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:52 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:53:52.672518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.682827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291dced-4a19-4d7b-a484-6ce88232218d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.689584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.690286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.690639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.691219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.692127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.694116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.707532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 889/1757] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:53:52.711476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.723906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e15d-2d2f-4be0-be5f-c110694f14b3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.728779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.729459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.729743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.730020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.730941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.732594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.745849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 890/1758] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:53:52.751612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.763057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c950d-dd1f-42e7-a80c-46b5a7b7e09b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.768458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d6b5-5ae7-4d27-8989-421c41eb7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.770097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d6b5-5ae7-4d27-8989-421c41eb7600 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.770455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d6b5-5ae7-4d27-8989-421c41eb7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.770829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d6b5-5ae7-4d27-8989-421c41eb7600 admin admin] PATH_INFO: `/v3/projects/0e3382ea22a747b588f8356957c3ae00/users/6665d99f983d43f9bc84dc233b03000b/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.783076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 869/1759] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:52 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:53:52.787704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:52.797939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d6b5-5ae7-4d27-8989-421c41eb7600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3382ea22a747b588f8356957c3ae00, user_id=6665d99f983d43f9bc84dc233b03000b, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.800803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d6b5-5ae7-4d27-8989-421c41eb7600 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.860731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5276d-58f7-47a6-b3e6-81e8265a89a4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:52.866078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:52.866301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.866772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.867198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.867940 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:52.870132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:52.918561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 891/1760] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:52 2022] PUT /identity/v3/projects/0e3382ea22a747b588f8356957c3ae00/users/6665d99f983d43f9bc84dc233b03000b/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:52.928575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47279-8b0c-4e90-a755-f80f72af6422 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:52.928896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47279-8b0c-4e90-a755-f80f72af6422 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:52.929176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47279-8b0c-4e90-a755-f80f72af6422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:52.959276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-afd47279-8b0c-4e90-a755-f80f72af6422 None None] MFA Rules not processed for user `6665d99f983d43f9bc84dc233b03000b`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:52.960511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-afd47279-8b0c-4e90-a755-f80f72af6422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:53.008846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 870/1761] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:52 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:53:53.010762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.023504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc4615-ee0b-43dd-9d20-d59f6aada2cb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.051887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 892/1762] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:53.056583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47279-8b0c-4e90-a755-f80f72af6422 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.096645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.097059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.097534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.097952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.098838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.100640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.114231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 871/1763] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:53.118543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.129814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ab046-6cbd-4eed-a507-b06bec2d4d0a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.134973 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.136002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.136386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.136764 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] PATH_INFO: `/v3/projects/7979789dcc9a4c5da2842844f6de9318/users/1cf31a4fb2214bbbb548d2f3bec089c2/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.138636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47279-8b0c-4e90-a755-f80f72af6422 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.149138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.149894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.150183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.150587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.151841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.161400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.163004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7979789dcc9a4c5da2842844f6de9318, user_id=1cf31a4fb2214bbbb548d2f3bec089c2, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.175628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.291866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 893/1764] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:53:53 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:53:53.296572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.302438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 872/1765] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:53 2022] PUT /identity/v3/projects/7979789dcc9a4c5da2842844f6de9318/users/1cf31a4fb2214bbbb548d2f3bec089c2/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:53.303999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.391264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98195ea-5570-4d98-ace6-517f581b441f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.419699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86d318-ba65-4598-bab5-856f93cd6953 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.429027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371af0e-c1a7-4cbe-ae42-3f913666a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.429985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371af0e-c1a7-4cbe-ae42-3f913666a7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.430976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371af0e-c1a7-4cbe-ae42-3f913666a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.431268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371af0e-c1a7-4cbe-ae42-3f913666a7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.433874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371af0e-c1a7-4cbe-ae42-3f913666a7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.437643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371af0e-c1a7-4cbe-ae42-3f913666a7a3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.478133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.483028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.483426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.483781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.485296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.487310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.501146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 873/1766] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:53.504886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.515424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed76f-30ae-4425-a282-2e8d4d18d1ae admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.523255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.524150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.524610 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.524919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] PATH_INFO: `/v3/projects/7979789dcc9a4c5da2842844f6de9318/users/1cf31a4fb2214bbbb548d2f3bec089c2/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.527061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7979789dcc9a4c5da2842844f6de9318, user_id=1cf31a4fb2214bbbb548d2f3bec089c2, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.529752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.545371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 874/1767] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:53 2022] PUT /identity/v3/projects/7979789dcc9a4c5da2842844f6de9318/users/1cf31a4fb2214bbbb548d2f3bec089c2/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:53:53.548643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.549244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 894/1768] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:53:53 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:53:53.557341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.557836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.558191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.591446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] MFA Rules not processed for user `1cf31a4fb2214bbbb548d2f3bec089c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:53.592044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:53.679149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805643e-1135-4c41-89ae-ed8ce3d9953c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.699356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.701187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.704865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.704865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.704865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.708366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.718132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 895/1769] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:53.728380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 875/1770] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:53:53.729525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.729657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.733389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:53.744991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894aee3-c660-4b68-8223-be6b161ca23b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.752662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.753561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.756711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.756711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] PATH_INFO: `/v3/projects/8252743a9cf44881a56f8a33bb5a8d77/users/cab7929d2f1d4b8f9790762658a62f4d/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.771790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8252743a9cf44881a56f8a33bb5a8d77, user_id=cab7929d2f1d4b8f9790762658a62f4d, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.776352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.840925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21795-8c84-4446-a61a-965fd56ce869 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:53.845651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:53.846320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:53.846603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:53.846915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:53.859565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:53.861765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:53.872232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 896/1771] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:53:53.971586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 876/1772] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:53 2022] PUT /identity/v3/projects/8252743a9cf44881a56f8a33bb5a8d77/users/cab7929d2f1d4b8f9790762658a62f4d/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:53.975961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:53.987659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd036adf-e0a2-43f1-9a28-319d09b426ba service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:54.061056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0ab57-9647-4475-b862-c0e538743538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:54.062246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ab57-9647-4475-b862-c0e538743538 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:54.062921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ab57-9647-4475-b862-c0e538743538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:54.063206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0ab57-9647-4475-b862-c0e538743538 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:54.063988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0ab57-9647-4475-b862-c0e538743538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:54.065626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0ab57-9647-4475-b862-c0e538743538 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:54.078584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 897/1773] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:53:54.080705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:54.091079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe51d-555b-478c-a49c-b8296aae43ac admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:54.096572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:54.097451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:54.097728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:54.099308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] PATH_INFO: `/v3/projects/8252743a9cf44881a56f8a33bb5a8d77/users/cab7929d2f1d4b8f9790762658a62f4d/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:54.100212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8252743a9cf44881a56f8a33bb5a8d77, user_id=cab7929d2f1d4b8f9790762658a62f4d, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:54.102868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:54.113263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 877/1774] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:53:54 2022] PUT /identity/v3/projects/8252743a9cf44881a56f8a33bb5a8d77/users/cab7929d2f1d4b8f9790762658a62f4d/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:54.129589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:54.130040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:54.130399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:54.167073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] MFA Rules not processed for user `cab7929d2f1d4b8f9790762658a62f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:54.168398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:54.266501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 898/1775] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:54.285997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:54.357659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abc59-d775-4135-a9e4-3469fcbf8e56 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:54.361791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:54.362784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:54.362984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:54.364056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:54.377096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:54.378819 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:54.392279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 878/1776] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:55.467029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:55.468064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:55.480451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62ea7f-66e7-414b-8702-b48fd5c1d314 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:55.491471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb2733-6d01-47c5-aaaf-92cf521f61c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:55.492175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2733-6d01-47c5-aaaf-92cf521f61c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:55.492463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2733-6d01-47c5-aaaf-92cf521f61c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:55.493256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2733-6d01-47c5-aaaf-92cf521f61c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:55.494927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fefb2733-6d01-47c5-aaaf-92cf521f61c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:55.537058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:55.562879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb2733-6d01-47c5-aaaf-92cf521f61c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:55.564384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb2733-6d01-47c5-aaaf-92cf521f61c0 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:55.574570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 899/1777] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:55.604732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9ff52-f8a6-4ab4-9ca5-e25331f1ec31 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:55.610773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:55.611867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:55.612327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:55.612776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] PATH_INFO: `/v3/users/6665d99f983d43f9bc84dc233b03000b` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:55.614075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6665d99f983d43f9bc84dc233b03000b)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:55.616102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:55.809314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6665d99f983d43f9bc84dc233b03000b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:55.822001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6665d99f983d43f9bc84dc233b03000b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:55.823044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6665d99f983d43f9bc84dc233b03000b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:55.950843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6665d99f983d43f9bc84dc233b03000b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:55.972268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6665d99f983d43f9bc84dc233b03000b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:55.983103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 879/1778] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:55 2022] DELETE /identity/v3/users/6665d99f983d43f9bc84dc233b03000b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:55.994866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:55.994866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:55.994866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:56.019142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:56.020596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:56.128882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 900/1779] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:56.142336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:56.147335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:56.219215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace433d-4eac-4158-bced-296a3903f3ea admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:56.223507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:56.224274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:56.224530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:56.224808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:56.239606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:56.241389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:56.260844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 880/1780] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:56.718675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:56.734487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:56.756750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6c46-8819-4ccf-ac1a-3ab90eb515a0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:56.771481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:56.771481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:56.771481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:56.771481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] PATH_INFO: `/v3/users/1855bc83a4784dfba26aae40aa45d829` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:56.772375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1855bc83a4784dfba26aae40aa45d829)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:56.772375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:57.029797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1855bc83a4784dfba26aae40aa45d829'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.060300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1855bc83a4784dfba26aae40aa45d829'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.161794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1855bc83a4784dfba26aae40aa45d829'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.164355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1855bc83a4784dfba26aae40aa45d829'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.183881 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:57.186880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:57.194013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a4fee98b-4f4a-4233-a4df-119335612492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1855bc83a4784dfba26aae40aa45d829'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.213216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37e4ba-9b0a-4c84-bf10-03193e2b5853 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:57.220045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 901/1781] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:56 2022] DELETE /identity/v3/users/1855bc83a4784dfba26aae40aa45d829 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:57.223079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:57.223641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:57.224117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:57.257826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:57.261412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:57.312084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:57.313955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:57.314412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:57.315304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] PATH_INFO: `/v3/projects/0e3382ea22a747b588f8356957c3ae00` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:57.317642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3382ea22a747b588f8356957c3ae00)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:57.320171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:57.349627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 902/1782] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:57.378793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:57.381005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:57.466204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ce3e5-369f-4d6b-b2d6-880991571a4e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:57.477600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:57.477600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:57.477600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:57.477600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:57.501017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3382ea22a747b588f8356957c3ae00', 'request_id': 'req-96cbdee6-9538-432d-8463-80999256e33d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.515596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3382ea22a747b588f8356957c3ae00', 'request_id': 'req-96cbdee6-9538-432d-8463-80999256e33d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.520124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:57.524068 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:57.538399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 903/1783] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:53:57.627715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3382ea22a747b588f8356957c3ae00', 'request_id': 'req-96cbdee6-9538-432d-8463-80999256e33d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.643171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] The token cache is being invalidate because project 0e3382ea22a747b588f8356957c3ae00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:57.643369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.644613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:57.652821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 881/1784] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:57 2022] DELETE /identity/v3/projects/0e3382ea22a747b588f8356957c3ae00 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:57.654948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:57.658783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:57.681354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d54d3f-45db-40c5-a54b-e8c7c6eb7d75 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:57.762157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:57.763094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:57.763373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:57.763640 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] PATH_INFO: `/v3/users/cab7929d2f1d4b8f9790762658a62f4d` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:57.767340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab7929d2f1d4b8f9790762658a62f4d)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:57.769325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:58.057716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab7929d2f1d4b8f9790762658a62f4d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:58.081624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab7929d2f1d4b8f9790762658a62f4d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:58.215665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab7929d2f1d4b8f9790762658a62f4d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:58.216303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab7929d2f1d4b8f9790762658a62f4d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:58.232751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab7929d2f1d4b8f9790762658a62f4d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:58.241174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 904/1785] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:57 2022] DELETE /identity/v3/users/cab7929d2f1d4b8f9790762658a62f4d => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:58.826874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:58.830315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:58.868499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbdee6-9538-432d-8463-80999256e33d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:59.008461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:59.011382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:59.013166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:59.019127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] PATH_INFO: `/v3/projects/08b806efef5643909294828d4173c36f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:59.021158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b806efef5643909294828d4173c36f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:59.025964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:59.211745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b806efef5643909294828d4173c36f', 'request_id': 'req-cd84f10c-bf4d-48c7-8745-741961afcec7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.240671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b806efef5643909294828d4173c36f', 'request_id': 'req-cd84f10c-bf4d-48c7-8745-741961afcec7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.289562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:59.291074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:59.340851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b806efef5643909294828d4173c36f', 'request_id': 'req-cd84f10c-bf4d-48c7-8745-741961afcec7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.358298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b814fda-def4-4c42-925c-61fd82b944c8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:59.376968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] The token cache is being invalidate because project 08b806efef5643909294828d4173c36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:59.381233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.387214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.389232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 882/1786] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:58 2022] DELETE /identity/v3/projects/08b806efef5643909294828d4173c36f => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:53:59.393552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:59.395196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:59.473187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:59.474666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:59.475269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:59.475687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] PATH_INFO: `/v3/projects/8252743a9cf44881a56f8a33bb5a8d77` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:59.477130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8252743a9cf44881a56f8a33bb5a8d77)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:59.480970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:59.483858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84f10c-bf4d-48c7-8745-741961afcec7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:53:59.489876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:53:59.490946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:59.491287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:59.491618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] PATH_INFO: `/v3/users/cc2582a25f8a466fb64cf2e5e506b9bc` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:59.494000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2582a25f8a466fb64cf2e5e506b9bc)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:53:59.495518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:53:59.644992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8252743a9cf44881a56f8a33bb5a8d77', 'request_id': 'req-6dcb152e-32cc-4151-83a9-714bfb07a136'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.650421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8252743a9cf44881a56f8a33bb5a8d77', 'request_id': 'req-6dcb152e-32cc-4151-83a9-714bfb07a136'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.752577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8252743a9cf44881a56f8a33bb5a8d77', 'request_id': 'req-6dcb152e-32cc-4151-83a9-714bfb07a136'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.771755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] The token cache is being invalidate because project 8252743a9cf44881a56f8a33bb5a8d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:53:59.772115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.773142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6dcb152e-32cc-4151-83a9-714bfb07a136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.801203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 905/1787] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:53:59 2022] DELETE /identity/v3/projects/8252743a9cf44881a56f8a33bb5a8d77 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:53:59.807387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74298f-9121-434a-97a4-aecebd73b067 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:59.807670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74298f-9121-434a-97a4-aecebd73b067 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:59.807945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74298f-9121-434a-97a4-aecebd73b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:59.810256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2582a25f8a466fb64cf2e5e506b9bc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.818845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2582a25f8a466fb64cf2e5e506b9bc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.819713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2582a25f8a466fb64cf2e5e506b9bc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.831160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ba74298f-9121-434a-97a4-aecebd73b067 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:59.832387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ba74298f-9121-434a-97a4-aecebd73b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:59.897799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 906/1788] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:53:59.906238 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2ee4-af6b-41cb-b56f-17fb1de57a9d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:53:59.906508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2ee4-af6b-41cb-b56f-17fb1de57a9d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:53:59.906812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2ee4-af6b-41cb-b56f-17fb1de57a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:53:59.915844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2582a25f8a466fb64cf2e5e506b9bc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.926584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-655a2ee4-af6b-41cb-b56f-17fb1de57a9d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:53:59.927798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-655a2ee4-af6b-41cb-b56f-17fb1de57a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:53:59.935059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2582a25f8a466fb64cf2e5e506b9bc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:53:59.936013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 907/1789] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:53:59.940614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2ee4-af6b-41cb-b56f-17fb1de57a9d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:53:59.945707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 883/1790] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:53:59 2022] DELETE /identity/v3/users/cc2582a25f8a466fb64cf2e5e506b9bc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:53:59.950013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2ee4-af6b-41cb-b56f-17fb1de57a9d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.007242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.007915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.008199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.008480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.009220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:00.009530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.011177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.023395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 908/1791] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:54:00.027836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.037647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c65a51-da63-4419-b9a7-2d0403155ebf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.042225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.042924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.045700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.045700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.045700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.046062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.226997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 884/1792] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:00 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:00.232046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.245196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a4c2-8fb7-41ff-bedc-5b43e7237213 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.310305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.311024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.311306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.311579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.312814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.314958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.398706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 909/1793] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:00 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:00.402928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.414102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56923-f451-4910-9251-9666cf5a7de6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.418950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.419660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.419950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.420230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.420974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.422652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.433515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 885/1794] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:00.438175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.444472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.446182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:00.453429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cf056-9424-4284-a6f9-72164bd6dafd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.461156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71a32e-f12b-4a48-81d6-9c1cb761bd5e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.461608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.462343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.462759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.463052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.463837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.465456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.466535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.467514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.467972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.468135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] PATH_INFO: `/v3/projects/515070126baf4d0d938f1aaadfc08f4b` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.469800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=515070126baf4d0d938f1aaadfc08f4b)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.472257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.477110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 910/1795] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:00.481044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.490999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911b6e9-2abc-4a16-994a-cdbc73e2d4d1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.496577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf3cf9-7642-4688-ad7e-dedd33b7ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.497578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf3cf9-7642-4688-ad7e-dedd33b7ffcd admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.497863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf3cf9-7642-4688-ad7e-dedd33b7ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.498393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf3cf9-7642-4688-ad7e-dedd33b7ffcd admin admin] PATH_INFO: `/v3/projects/8f6bd4986323493cb1cbf97494e6cc9d/users/6405b70d86b14177b2df969fe9fda0fe/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.517353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf3cf9-7642-4688-ad7e-dedd33b7ffcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6bd4986323493cb1cbf97494e6cc9d, user_id=6405b70d86b14177b2df969fe9fda0fe, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.520077 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf3cf9-7642-4688-ad7e-dedd33b7ffcd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.681726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 911/1796] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:00 2022] PUT /identity/v3/projects/8f6bd4986323493cb1cbf97494e6cc9d/users/6405b70d86b14177b2df969fe9fda0fe/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:00.683577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e275-8086-443c-b90b-e4a1daf5d78c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.683875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e275-8086-443c-b90b-e4a1daf5d78c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.684154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e275-8086-443c-b90b-e4a1daf5d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.687450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515070126baf4d0d938f1aaadfc08f4b', 'request_id': 'req-1856cf32-dc5e-4c85-875e-f6f56072c98a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:00.695553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515070126baf4d0d938f1aaadfc08f4b', 'request_id': 'req-1856cf32-dc5e-4c85-875e-f6f56072c98a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:00.716413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-7a68e275-8086-443c-b90b-e4a1daf5d78c None None] MFA Rules not processed for user `6405b70d86b14177b2df969fe9fda0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:00.717668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7a68e275-8086-443c-b90b-e4a1daf5d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:00.798311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 912/1797] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:00.802846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68e275-8086-443c-b90b-e4a1daf5d78c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.848103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515070126baf4d0d938f1aaadfc08f4b', 'request_id': 'req-1856cf32-dc5e-4c85-875e-f6f56072c98a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:00.862713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] The token cache is being invalidate because project 515070126baf4d0d938f1aaadfc08f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:00.863024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:00.863807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1856cf32-dc5e-4c85-875e-f6f56072c98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:00.866489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 886/1798] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:00 2022] DELETE /identity/v3/projects/515070126baf4d0d938f1aaadfc08f4b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:00.872232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc53d-43fc-4730-8316-855a3d298ff7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.872554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc53d-43fc-4730-8316-855a3d298ff7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.873449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cc53d-43fc-4730-8316-855a3d298ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.890673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68e275-8086-443c-b90b-e4a1daf5d78c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.895271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e82cc53d-43fc-4730-8316-855a3d298ff7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:00.896065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.896473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e82cc53d-43fc-4730-8316-855a3d298ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:00.896873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.897218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.897556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.898317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.900805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.910194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 887/1799] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:00.934038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde60399-e5f6-4483-8845-fcebf7ac05f6 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.934617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde60399-e5f6-4483-8845-fcebf7ac05f6 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.934617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde60399-e5f6-4483-8845-fcebf7ac05f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.952577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dde60399-e5f6-4483-8845-fcebf7ac05f6 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:00.953795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dde60399-e5f6-4483-8845-fcebf7ac05f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:00.961433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 888/1800] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:00.965233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde60399-e5f6-4483-8845-fcebf7ac05f6 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:00.973663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde60399-e5f6-4483-8845-fcebf7ac05f6 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:00.978152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:00.978802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:00.979086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:00.979358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:00.980074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:00.980386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:00.981952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:00.994482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 889/1801] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:54:00.998698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.010656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8a5cf-b465-4a72-ab38-a50dbd7c9825 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.015540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.016338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.016625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.016896 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.017634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.019563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.132223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 913/1802] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:00 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:01.133405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.135120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:01.169156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 890/1803] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:00 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:01.170214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.207204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f9e2b-100c-42b1-9822-a10cafa09eeb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.233743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb4cb5-63f9-4358-8300-578087c8005b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.240132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.240795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.241075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.241349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.242127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.244057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.272223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.272921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.273204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.273501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.274216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.276158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.377113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 891/1804] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:01 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:01.380247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 914/1805] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:01 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:01.381233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.384564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.402831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570e76e-f584-4040-99d9-32a226510d4a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.404337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0bc5-d691-4d87-bdf5-894ad1b4bd9f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.410952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a2f8b-6a5d-42e7-8cc7-b5007b300103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.412170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a2f8b-6a5d-42e7-8cc7-b5007b300103 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.412798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a2f8b-6a5d-42e7-8cc7-b5007b300103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.413956 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a2f8b-6a5d-42e7-8cc7-b5007b300103 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.415355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a2f8b-6a5d-42e7-8cc7-b5007b300103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.417920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a2f8b-6a5d-42e7-8cc7-b5007b300103 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.418872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.419556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.419834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.420113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.420861 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.423013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.437012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 892/1806] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:01.439094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ed38d-a72c-458a-bd9e-31d3e683a681 None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.439687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ed38d-a72c-458a-bd9e-31d3e683a681 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.440051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ed38d-a72c-458a-bd9e-31d3e683a681 None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.441762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 915/1807] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:01.442381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 893/1808] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:54:01.442622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.443355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ed38d-a72c-458a-bd9e-31d3e683a681 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.461911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009150c-f117-404f-9e86-a0208772be45 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.467352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ed38d-a72c-458a-bd9e-31d3e683a681 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.472572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.473840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.473840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.474037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] PATH_INFO: `/v3/projects/f8214868edf54008a8082ba928e0c35a/users/7ddc69747d9147fabb6683c83a40430b/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.474353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf7c1e-6499-47ff-bf9f-baea6c353ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.475193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf7c1e-6499-47ff-bf9f-baea6c353ffa admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.475500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf7c1e-6499-47ff-bf9f-baea6c353ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.475768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf7c1e-6499-47ff-bf9f-baea6c353ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.476574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf7c1e-6499-47ff-bf9f-baea6c353ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.478402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf7c1e-6499-47ff-bf9f-baea6c353ffa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.491085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 916/1809] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:01.492542 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8214868edf54008a8082ba928e0c35a, user_id=7ddc69747d9147fabb6683c83a40430b, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.493134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d55d1-8aab-4633-9590-e94fd148e9b5 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.493722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d55d1-8aab-4633-9590-e94fd148e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.494232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d55d1-8aab-4633-9590-e94fd148e9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.495718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.516544 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b85d55d1-8aab-4633-9590-e94fd148e9b5 None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:01.517843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b85d55d1-8aab-4633-9590-e94fd148e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:01.594305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 894/1810] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:01 2022] PUT /identity/v3/projects/f8214868edf54008a8082ba928e0c35a/users/7ddc69747d9147fabb6683c83a40430b/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:01.595248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.617928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 917/1811] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:54:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:01.619146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d55d1-8aab-4633-9590-e94fd148e9b5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.630095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d55d1-8aab-4633-9590-e94fd148e9b5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.663652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073cfb8-d552-48e6-8b72-94a0d3b55bbc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.668846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.669817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.676702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.676702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] PATH_INFO: `/v3/projects/9cfd60682fd742e8a90d558d4aa068d3/users/1f067418abf34ef8adecddee5ad4da9c/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.686454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfd60682fd742e8a90d558d4aa068d3, user_id=1f067418abf34ef8adecddee5ad4da9c, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.690216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.694524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.695786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.696080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.699420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.699420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.699420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.711734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 918/1812] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:01.712777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.714701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:01.789874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c831-9511-4189-a8ad-ad33bea3f1f9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.796027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86a23d-6182-4bbb-a6a8-121b70f75e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.797264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a23d-6182-4bbb-a6a8-121b70f75e4c service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.797549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a23d-6182-4bbb-a6a8-121b70f75e4c service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.797828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a23d-6182-4bbb-a6a8-121b70f75e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.807812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86a23d-6182-4bbb-a6a8-121b70f75e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.814157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86a23d-6182-4bbb-a6a8-121b70f75e4c service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:01.822506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 895/1813] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:01 2022] PUT /identity/v3/projects/9cfd60682fd742e8a90d558d4aa068d3/users/1f067418abf34ef8adecddee5ad4da9c/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:01.823567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 919/1814] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:01.824386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.832985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f02c-af8b-4b92-a4d6-7122278c1f0d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.833352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f02c-af8b-4b92-a4d6-7122278c1f0d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.833704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f02c-af8b-4b92-a4d6-7122278c1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.863919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6e45f02c-af8b-4b92-a4d6-7122278c1f0d None None] MFA Rules not processed for user `1f067418abf34ef8adecddee5ad4da9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:01.865904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6e45f02c-af8b-4b92-a4d6-7122278c1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:01.973352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f82d3-3a8b-4637-bfc3-ad7d76e93c0d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:01.979603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 920/1815] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:01.981693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2192bc-f00e-450d-be7e-1c1de6e57c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:01.983197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2192bc-f00e-450d-be7e-1c1de6e57c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:01.984077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2192bc-f00e-450d-be7e-1c1de6e57c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:01.984077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2192bc-f00e-450d-be7e-1c1de6e57c84 admin admin] PATH_INFO: `/v3/projects/f8214868edf54008a8082ba928e0c35a/users/7ddc69747d9147fabb6683c83a40430b/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:01.985193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f02c-af8b-4b92-a4d6-7122278c1f0d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:01.991410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2192bc-f00e-450d-be7e-1c1de6e57c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8214868edf54008a8082ba928e0c35a, user_id=7ddc69747d9147fabb6683c83a40430b, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:01.997042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2192bc-f00e-450d-be7e-1c1de6e57c84 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.004765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f02c-af8b-4b92-a4d6-7122278c1f0d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.015656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.016325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.016608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.016883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.017600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.029954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 896/1816] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:01 2022] PUT /identity/v3/projects/f8214868edf54008a8082ba928e0c35a/users/7ddc69747d9147fabb6683c83a40430b/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:02.030337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.034116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.034402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.034684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.091006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] MFA Rules not processed for user `7ddc69747d9147fabb6683c83a40430b`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:02.092656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:02.185275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 921/1817] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:01 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:02.186578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 897/1818] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:02.189904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.203742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.206159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:02.262116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897bdef-0846-4340-a805-4a6820deb5f2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.267524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.268383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.268669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.268944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.269658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.271779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.276223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a9be-6e33-47c8-a3e9-8d5844cdb290 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.330634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.331324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.331605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.331903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.357715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 922/1819] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:02 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:02.361579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.373324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bb37-01bb-4b49-b2b0-822d75256765 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.378289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.379130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.379489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.379865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.380810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.382847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.393985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 923/1820] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:02.393985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.393985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:02.410539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c5bd-373d-439e-8ce6-2707c30e8c6a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.410842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.412350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.414598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.415392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.415683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.415965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.417889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:02.422593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 898/1821] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:02.423537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.434089 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0521a1d-d47e-407b-89e0-1af1762837c0 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.449333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.450027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.450316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.450593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] PATH_INFO: `/v3/projects/4dfb7b50aa7040578c9e6547cc546e2c/users/1ebc01d9de3343e6985e6cec9f75742c/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.479093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfb7b50aa7040578c9e6547cc546e2c, user_id=1ebc01d9de3343e6985e6cec9f75742c, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.481983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.508912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.510430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.520691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 924/1822] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:02.521534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.532781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e914775-eb3e-4feb-81d1-f06efc5427a5 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.538198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.538455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.538841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.539065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] PATH_INFO: `/v3/users/6405b70d86b14177b2df969fe9fda0fe` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.540454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6405b70d86b14177b2df969fe9fda0fe)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.542379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.582127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 899/1823] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:02 2022] PUT /identity/v3/projects/4dfb7b50aa7040578c9e6547cc546e2c/users/1ebc01d9de3343e6985e6cec9f75742c/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:02.586013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.658376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cedca-c8af-42d9-b284-2d15d9320a82 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.663755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.664178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.664465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.665142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.665624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.667844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.682460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 900/1824] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:02.683607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.695178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79913299-7ae4-40bc-a6fe-08b8cb1df63b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.702950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5100f-3879-4c5e-b3d7-c507e9189182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.703802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5100f-3879-4c5e-b3d7-c507e9189182 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.704153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5100f-3879-4c5e-b3d7-c507e9189182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.704500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5100f-3879-4c5e-b3d7-c507e9189182 admin admin] PATH_INFO: `/v3/projects/4dfb7b50aa7040578c9e6547cc546e2c/users/1ebc01d9de3343e6985e6cec9f75742c/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.706573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5100f-3879-4c5e-b3d7-c507e9189182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfb7b50aa7040578c9e6547cc546e2c, user_id=1ebc01d9de3343e6985e6cec9f75742c, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.709458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5100f-3879-4c5e-b3d7-c507e9189182 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.720995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 901/1825] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:02 2022] PUT /identity/v3/projects/4dfb7b50aa7040578c9e6547cc546e2c/users/1ebc01d9de3343e6985e6cec9f75742c/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:02.731098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66629-fe9f-4488-b3d0-9b5e9ca663b3 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.731388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66629-fe9f-4488-b3d0-9b5e9ca663b3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.731668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea66629-fe9f-4488-b3d0-9b5e9ca663b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.760816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dea66629-fe9f-4488-b3d0-9b5e9ca663b3 None None] MFA Rules not processed for user `1ebc01d9de3343e6985e6cec9f75742c`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:02.762114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dea66629-fe9f-4488-b3d0-9b5e9ca663b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:02.775077 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6405b70d86b14177b2df969fe9fda0fe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:02.795130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6405b70d86b14177b2df969fe9fda0fe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:02.839725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 902/1826] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:02.850234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66629-fe9f-4488-b3d0-9b5e9ca663b3 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:02.904347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea66629-fe9f-4488-b3d0-9b5e9ca663b3 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:02.908813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3a58-0b8f-4ff3-8ebe-00c53e9b665b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:02.911362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3a58-0b8f-4ff3-8ebe-00c53e9b665b service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.911659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3a58-0b8f-4ff3-8ebe-00c53e9b665b service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.911944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3a58-0b8f-4ff3-8ebe-00c53e9b665b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.916478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6405b70d86b14177b2df969fe9fda0fe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:02.916478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6405b70d86b14177b2df969fe9fda0fe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:02.923441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3a58-0b8f-4ff3-8ebe-00c53e9b665b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:02.924910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3a58-0b8f-4ff3-8ebe-00c53e9b665b service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:02.927531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6405b70d86b14177b2df969fe9fda0fe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:02.934672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 903/1827] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:02.939007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 925/1828] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:02 2022] DELETE /identity/v3/users/6405b70d86b14177b2df969fe9fda0fe => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:02.942199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:02.942490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:02.942804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:02.960304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:02.961491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:03.023437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 904/1829] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:03.030320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:03.033003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:03.102931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891487bb-5201-4d2a-a220-ff3aa22e4967 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:03.107102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:03.107854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:03.108314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:03.108656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:03.121496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:03.123816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:03.136382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 926/1830] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:03.219961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:03.221400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:03.322603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32e6f-636a-4151-9c8e-a95e4eaba3fa None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:03.325197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:03.325849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:03.326132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:03.326407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:03.328368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:03.451958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:03.453771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:03.464574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 905/1831] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:03.703146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:03.705565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:03.719452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48e26c-7bb4-4725-b53a-6a87ee8bbdf6 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:03.724226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:03.725088 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:03.725404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:03.725681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] PATH_INFO: `/v3/projects/8f6bd4986323493cb1cbf97494e6cc9d` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:03.726925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6bd4986323493cb1cbf97494e6cc9d)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:03.728832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:03.885376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6bd4986323493cb1cbf97494e6cc9d', 'request_id': 'req-b251dc2b-3337-4458-bcb9-098d7119f3a1'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:03.892051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6bd4986323493cb1cbf97494e6cc9d', 'request_id': 'req-b251dc2b-3337-4458-bcb9-098d7119f3a1'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.007929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6bd4986323493cb1cbf97494e6cc9d', 'request_id': 'req-b251dc2b-3337-4458-bcb9-098d7119f3a1'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.038862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] The token cache is being invalidate because project 8f6bd4986323493cb1cbf97494e6cc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:04.040127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.041707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.044133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 927/1832] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:03 2022] DELETE /identity/v3/projects/8f6bd4986323493cb1cbf97494e6cc9d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:04.049567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:04.066090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2f95e-6298-4a60-a6c3-b1f5c169bd7a service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:04.170766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:04.172210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:04.172210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:04.172379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] PATH_INFO: `/v3/users/7ddc69747d9147fabb6683c83a40430b` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:04.173633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ddc69747d9147fabb6683c83a40430b)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:04.175583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:04.493716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ddc69747d9147fabb6683c83a40430b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.501670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ddc69747d9147fabb6683c83a40430b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.502671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ddc69747d9147fabb6683c83a40430b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.615454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ddc69747d9147fabb6683c83a40430b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.633259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-28a8b5d0-6549-4dc3-95b8-96c30206e7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ddc69747d9147fabb6683c83a40430b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:04.649960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 906/1833] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:04 2022] DELETE /identity/v3/users/7ddc69747d9147fabb6683c83a40430b => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:05.119783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:05.121226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:05.143072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251dc2b-3337-4458-bcb9-098d7119f3a1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:05.215849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:05.216727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:05.217012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:05.219283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] PATH_INFO: `/v3/projects/f8214868edf54008a8082ba928e0c35a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:05.219283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8214868edf54008a8082ba928e0c35a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:05.220692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:05.364241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8214868edf54008a8082ba928e0c35a', 'request_id': 'req-fb66ee70-5bf4-4051-ad41-091721da06b0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:05.373175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8214868edf54008a8082ba928e0c35a', 'request_id': 'req-fb66ee70-5bf4-4051-ad41-091721da06b0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:05.432138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8214868edf54008a8082ba928e0c35a', 'request_id': 'req-fb66ee70-5bf4-4051-ad41-091721da06b0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:05.443751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] The token cache is being invalidate because project f8214868edf54008a8082ba928e0c35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:05.444039 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:05.444662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb66ee70-5bf4-4051-ad41-091721da06b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:05.446198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 928/1834] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:05 2022] DELETE /identity/v3/projects/f8214868edf54008a8082ba928e0c35a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:05.455731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf5209-3054-41dc-a51c-4b6c38ee023f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:05.456213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf5209-3054-41dc-a51c-4b6c38ee023f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:05.456300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf5209-3054-41dc-a51c-4b6c38ee023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:05.475717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d6bf5209-3054-41dc-a51c-4b6c38ee023f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:05.476941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d6bf5209-3054-41dc-a51c-4b6c38ee023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:05.537598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 907/1835] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:05.545591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b792b1b-d46d-4d3d-98bd-d0fb82ac07c4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:05.545882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b792b1b-d46d-4d3d-98bd-d0fb82ac07c4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:05.546162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b792b1b-d46d-4d3d-98bd-d0fb82ac07c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:05.565435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9b792b1b-d46d-4d3d-98bd-d0fb82ac07c4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:05.566701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9b792b1b-d46d-4d3d-98bd-d0fb82ac07c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:05.575894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 929/1836] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:05.580510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf5209-3054-41dc-a51c-4b6c38ee023f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:05.591011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf5209-3054-41dc-a51c-4b6c38ee023f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:05.603437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:05.604126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:05.604411 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:05.604752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:05.605500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:05.605823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:05.607481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:05.626058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 908/1837] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:05.635432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b792b1b-d46d-4d3d-98bd-d0fb82ac07c4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:05.646036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b792b1b-d46d-4d3d-98bd-d0fb82ac07c4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:05.650808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:05.651478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:05.651904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:05.652191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:05.652970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:05.654958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:05.742070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 930/1838] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:05 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:05.746741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:05.758058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268438be-ee88-4f4f-a491-8b6378f0e8cb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:05.820332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:05.821009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:05.821470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:05.821751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:05.822477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:05.827695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:05.980427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:05.987666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 909/1839] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:05 2022] POST /identity/v3/users => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:05.991162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e075d-c0b9-422d-a65e-9f3d24a50b8f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:05.995801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:05.996532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:05.996817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:05.997093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:05.998625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:06.002708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:06.013877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 931/1840] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:06.018915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:06.028981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd428f-4921-49dc-bb35-9568a84b9af6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:06.034369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c452d7-1488-4943-bb31-e2ae2b92c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:06.035236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c452d7-1488-4943-bb31-e2ae2b92c290 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:06.035523 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c452d7-1488-4943-bb31-e2ae2b92c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:06.035798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c452d7-1488-4943-bb31-e2ae2b92c290 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:06.036545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c452d7-1488-4943-bb31-e2ae2b92c290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:06.038157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c452d7-1488-4943-bb31-e2ae2b92c290 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:06.048885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 910/1841] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:06.054890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:06.065010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c640d-c563-43c9-a2cc-063ac3072bde admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:06.069603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:06.070880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:06.071052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:06.071298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] PATH_INFO: `/v3/projects/5d042fdceea14585ad9c27eabd786c3a/users/f1638785cf554b629aa40f0094e00358/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:06.087136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d042fdceea14585ad9c27eabd786c3a, user_id=f1638785cf554b629aa40f0094e00358, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:06.090131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:06.263543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 932/1842] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:06 2022] PUT /identity/v3/projects/5d042fdceea14585ad9c27eabd786c3a/users/f1638785cf554b629aa40f0094e00358/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:06.276051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756f72-00d2-47f4-9d8b-79d81714b333 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:06.276718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756f72-00d2-47f4-9d8b-79d81714b333 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:06.276718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756f72-00d2-47f4-9d8b-79d81714b333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:06.309315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-40756f72-00d2-47f4-9d8b-79d81714b333 None None] MFA Rules not processed for user `f1638785cf554b629aa40f0094e00358`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:06.310539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-40756f72-00d2-47f4-9d8b-79d81714b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:06.387645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 911/1843] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:06.390892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:06.478797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90871118-8bfd-44f0-8872-717901cc792b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:06.483615 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:06.484727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:06.485010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:06.485285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:06.485991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:06.488298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:06.623694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 933/1844] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:06 2022] POST /identity/v3/projects => generated 401 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:06.627721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756f72-00d2-47f4-9d8b-79d81714b333 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:06.638850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756f72-00d2-47f4-9d8b-79d81714b333 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:06.703209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:06.704051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:06.704492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:06.704927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:06.705870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:06.707921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:06.861181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:06.861441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 912/1845] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:06 2022] POST /identity/v3/users => generated 307 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:06.886022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010acf-975a-41aa-a806-0048eff86428 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:06.892044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:06.892960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:06.893343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:06.893739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:06.894644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:06.896444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:06.909097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 934/1846] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:06.913660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:06.925043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea2ac-94ee-4bb4-bef7-885d63dc6cb1 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:06.932671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:06.933977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:06.934463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:06.934765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] PATH_INFO: `/v3/projects/a8de23a749054fcbb464604aaa40429e/users/af9fd15cef5e49c584bb0bff3ac3519f/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:06.956164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8de23a749054fcbb464604aaa40429e, user_id=af9fd15cef5e49c584bb0bff3ac3519f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:06.958865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:07.041954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 913/1847] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:06 2022] PUT /identity/v3/projects/a8de23a749054fcbb464604aaa40429e/users/af9fd15cef5e49c584bb0bff3ac3519f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:07.048245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:07.060629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c5c5-ea10-4640-b538-ae9675b0eeb0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:07.130951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcc4e8-8f07-4627-a1c6-f5967cf1cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:07.131750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcc4e8-8f07-4627-a1c6-f5967cf1cd62 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:07.132035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcc4e8-8f07-4627-a1c6-f5967cf1cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:07.132316 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcc4e8-8f07-4627-a1c6-f5967cf1cd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:07.133067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcc4e8-8f07-4627-a1c6-f5967cf1cd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:07.134662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcc4e8-8f07-4627-a1c6-f5967cf1cd62 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:07.146771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 935/1848] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:07.148925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:07.159948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98993f2-ab72-4093-a9d8-21d112916e16 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:07.164854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:07.165540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:07.165822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:07.166096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] PATH_INFO: `/v3/projects/a8de23a749054fcbb464604aaa40429e/users/af9fd15cef5e49c584bb0bff3ac3519f/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:07.168095 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8de23a749054fcbb464604aaa40429e, user_id=af9fd15cef5e49c584bb0bff3ac3519f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:07.170799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:07.182200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 914/1849] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:07 2022] PUT /identity/v3/projects/a8de23a749054fcbb464604aaa40429e/users/af9fd15cef5e49c584bb0bff3ac3519f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:07.192456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:07.192820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:07.193100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:07.226305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] MFA Rules not processed for user `af9fd15cef5e49c584bb0bff3ac3519f`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:07.228118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:07.314477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 936/1850] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:07.530501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:07.532254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:07.596801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699935-c710-4dc1-9df6-67e9d3512d98 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:07.600942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:07.601594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:07.601966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:07.602252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:07.612161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:07.614269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:07.629070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 915/1851] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:08.223909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:08.225734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:08.297900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e32f6-e7bb-4314-b8ad-1cca10576a17 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:08.302624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:08.303520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:08.303800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:08.304079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] PATH_INFO: `/v3/users/e17c5b28ca9d4ce9bf4e0587bda1b0d0` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:08.305285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17c5b28ca9d4ce9bf4e0587bda1b0d0)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:08.307243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:08.387070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:08.396000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ddf95-9fb0-4071-944a-1c80abbe384d service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:08.399671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:08.400314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:08.400595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:08.401087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:08.458029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:08.459501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:08.474937 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 916/1852] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:08.521746 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17c5b28ca9d4ce9bf4e0587bda1b0d0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:08.530303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17c5b28ca9d4ce9bf4e0587bda1b0d0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:08.546242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:08.547868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:08.567126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f0ca-beeb-4ea6-9ce5-ce1b48c9d735 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:08.573191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:08.574130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:08.574416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:08.574708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] PATH_INFO: `/v3/users/1f067418abf34ef8adecddee5ad4da9c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:08.576022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f067418abf34ef8adecddee5ad4da9c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:08.578577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:08.652940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17c5b28ca9d4ce9bf4e0587bda1b0d0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:08.653569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17c5b28ca9d4ce9bf4e0587bda1b0d0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:08.667486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6eb08628-c825-46c6-a1e7-ef467ce68d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17c5b28ca9d4ce9bf4e0587bda1b0d0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:08.674398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 937/1853] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:08 2022] DELETE /identity/v3/users/e17c5b28ca9d4ce9bf4e0587bda1b0d0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:08.680211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:08.680554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:08.680829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:08.701460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:08.703174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:08.772593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 938/1854] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:08.782910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:08.784285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:08.847813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd143-610c-4e6c-b2ff-d510e374a943 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:08.852210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ddc29-20e3-4cff-8682-bad7370973fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:08.852859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddc29-20e3-4cff-8682-bad7370973fc service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:08.853140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddc29-20e3-4cff-8682-bad7370973fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:08.853417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddc29-20e3-4cff-8682-bad7370973fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:08.863304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ddc29-20e3-4cff-8682-bad7370973fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:08.864808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ddc29-20e3-4cff-8682-bad7370973fc service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:08.876171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 939/1855] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:08.889238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f067418abf34ef8adecddee5ad4da9c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:08.898082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f067418abf34ef8adecddee5ad4da9c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:08.898744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f067418abf34ef8adecddee5ad4da9c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.110217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f067418abf34ef8adecddee5ad4da9c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.113795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f067418abf34ef8adecddee5ad4da9c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.119874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 917/1856] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:08 2022] DELETE /identity/v3/users/1f067418abf34ef8adecddee5ad4da9c => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:09.124883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:09.125245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:09.125593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:09.143361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:09.144558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:09.238848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 940/1857] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:09.254475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:09.256681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:09.321174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d0785-7429-436a-82f4-017477fb1943 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:09.325052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:09.325884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:09.326346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:09.326695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:09.336907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:09.338422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:09.348742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 918/1858] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:09.549576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:09.551618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:09.563820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaa0a5-fbf9-41ee-82a1-4f5fdb171ad4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:09.568565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:09.569695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:09.569977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:09.570252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] PATH_INFO: `/v3/projects/b02bf989a2c84864b9f0bd1256bd628b` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:09.571536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02bf989a2c84864b9f0bd1256bd628b)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:09.573435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:09.772326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02bf989a2c84864b9f0bd1256bd628b', 'request_id': 'req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.779257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02bf989a2c84864b9f0bd1256bd628b', 'request_id': 'req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.881838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02bf989a2c84864b9f0bd1256bd628b', 'request_id': 'req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.901168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] The token cache is being invalidate because project b02bf989a2c84864b9f0bd1256bd628b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:09.902687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.903941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:09.912302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 941/1859] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:09 2022] DELETE /identity/v3/projects/b02bf989a2c84864b9f0bd1256bd628b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:09.916063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:09.926943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e49a09-94b4-4330-b0b6-9d69a3cc7a06 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:09.984983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:09.985965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:09.986403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:09.986677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] PATH_INFO: `/v3/users/b6a4cf1a093b40458b16be5ac55ef3e9` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:09.988032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a4cf1a093b40458b16be5ac55ef3e9)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:09.989966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:10.011808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:10.013454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:10.036725 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d601f3-ecb2-4ada-b1d8-9507140dc1ef admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:10.053061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:10.054154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:10.054513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:10.054890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] PATH_INFO: `/v3/projects/9cfd60682fd742e8a90d558d4aa068d3` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:10.057512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfd60682fd742e8a90d558d4aa068d3)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:10.060692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:10.255124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a4cf1a093b40458b16be5ac55ef3e9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.263464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a4cf1a093b40458b16be5ac55ef3e9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.264901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a4cf1a093b40458b16be5ac55ef3e9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.274285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfd60682fd742e8a90d558d4aa068d3', 'request_id': 'req-1077cd0a-e482-42b2-b50e-222aaee68556'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.284295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfd60682fd742e8a90d558d4aa068d3', 'request_id': 'req-1077cd0a-e482-42b2-b50e-222aaee68556'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.384649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a4cf1a093b40458b16be5ac55ef3e9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.401129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a4cf1a093b40458b16be5ac55ef3e9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.411593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 919/1860] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:09 2022] DELETE /identity/v3/users/b6a4cf1a093b40458b16be5ac55ef3e9 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:10.506263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfd60682fd742e8a90d558d4aa068d3', 'request_id': 'req-1077cd0a-e482-42b2-b50e-222aaee68556'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.526552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] The token cache is being invalidate because project 9cfd60682fd742e8a90d558d4aa068d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:10.526912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.527571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.529330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 942/1861] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:10 2022] DELETE /identity/v3/projects/9cfd60682fd742e8a90d558d4aa068d3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:10.533165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:10.535057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:10.601656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898f21-4246-41db-bbf5-1889dd878a5b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:10.607112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:10.607988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:10.608277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:10.608893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] PATH_INFO: `/v3/users/1ebc01d9de3343e6985e6cec9f75742c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:10.610149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebc01d9de3343e6985e6cec9f75742c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:10.612970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:10.775118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebc01d9de3343e6985e6cec9f75742c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.783575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebc01d9de3343e6985e6cec9f75742c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.784398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebc01d9de3343e6985e6cec9f75742c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.887720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebc01d9de3343e6985e6cec9f75742c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.903111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebc01d9de3343e6985e6cec9f75742c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:10.910991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 920/1862] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:10 2022] DELETE /identity/v3/users/1ebc01d9de3343e6985e6cec9f75742c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:11.162668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:11.164886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:11.293354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077cd0a-e482-42b2-b50e-222aaee68556 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:11.361526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:11.362471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:11.362776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:11.363060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] PATH_INFO: `/v3/projects/92b952c7d1c1417993cba24929dc4509` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:11.364561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b952c7d1c1417993cba24929dc4509)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:11.368033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:11.472261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:11.474259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:11.513523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b952c7d1c1417993cba24929dc4509', 'request_id': 'req-f2767edc-b78c-4e47-bdee-8fe672cdd572'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:11.525115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b952c7d1c1417993cba24929dc4509', 'request_id': 'req-f2767edc-b78c-4e47-bdee-8fe672cdd572'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:11.559968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b25a99-77be-45e1-a5ce-a362792a6619 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:11.618610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b952c7d1c1417993cba24929dc4509', 'request_id': 'req-f2767edc-b78c-4e47-bdee-8fe672cdd572'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:11.634518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] The token cache is being invalidate because project 92b952c7d1c1417993cba24929dc4509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:11.634834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:11.648874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:11.649771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:11.650052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:11.650325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] PATH_INFO: `/v3/projects/4dfb7b50aa7040578c9e6547cc546e2c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:11.651315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:11.659947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dfb7b50aa7040578c9e6547cc546e2c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:11.661427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 943/1863] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:11 2022] DELETE /identity/v3/projects/92b952c7d1c1417993cba24929dc4509 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:11.663785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:11.665243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:11.667848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:11.701131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767edc-b78c-4e47-bdee-8fe672cdd572 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:11.718501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:11.719659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:11.720285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:11.720803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] PATH_INFO: `/v3/users/1cf31a4fb2214bbbb548d2f3bec089c2` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:11.722292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf31a4fb2214bbbb548d2f3bec089c2)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:11.724823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:11.922107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dfb7b50aa7040578c9e6547cc546e2c', 'request_id': 'req-51d97b80-ab2c-4b8a-b405-cb150123f669'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:11.938092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dfb7b50aa7040578c9e6547cc546e2c', 'request_id': 'req-51d97b80-ab2c-4b8a-b405-cb150123f669'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.015601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf31a4fb2214bbbb548d2f3bec089c2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.024871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf31a4fb2214bbbb548d2f3bec089c2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.060896 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dfb7b50aa7040578c9e6547cc546e2c', 'request_id': 'req-51d97b80-ab2c-4b8a-b405-cb150123f669'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.079140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] The token cache is being invalidate because project 4dfb7b50aa7040578c9e6547cc546e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:12.079439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.080108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-51d97b80-ab2c-4b8a-b405-cb150123f669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.089627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 921/1864] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:11 2022] DELETE /identity/v3/projects/4dfb7b50aa7040578c9e6547cc546e2c => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:12.091219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40affb4-89e3-4dc4-a762-07a9cd30f428 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:12.091506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40affb4-89e3-4dc4-a762-07a9cd30f428 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:12.091786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40affb4-89e3-4dc4-a762-07a9cd30f428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:12.133258 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b40affb4-89e3-4dc4-a762-07a9cd30f428 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:12.134504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b40affb4-89e3-4dc4-a762-07a9cd30f428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:12.164233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf31a4fb2214bbbb548d2f3bec089c2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.165883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf31a4fb2214bbbb548d2f3bec089c2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.190459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-26c005ed-45d4-484a-a750-5531a8ee3a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf31a4fb2214bbbb548d2f3bec089c2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:12.201532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 944/1865] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:11 2022] DELETE /identity/v3/users/1cf31a4fb2214bbbb548d2f3bec089c2 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:12.225543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 922/1866] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:12.235499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb742340-d12e-4520-b846-1c5b45a1dfe5 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:12.235796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb742340-d12e-4520-b846-1c5b45a1dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:12.236143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb742340-d12e-4520-b846-1c5b45a1dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:12.256215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-fb742340-d12e-4520-b846-1c5b45a1dfe5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:12.257456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fb742340-d12e-4520-b846-1c5b45a1dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:12.379008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 945/1867] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:12.383154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40affb4-89e3-4dc4-a762-07a9cd30f428 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:12.399735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40affb4-89e3-4dc4-a762-07a9cd30f428 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:12.412802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:12.414207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:12.414505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:12.414807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:12.415570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:12.418828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:12.423286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:12.474517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 923/1868] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:12.475134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb742340-d12e-4520-b846-1c5b45a1dfe5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:12.488625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb742340-d12e-4520-b846-1c5b45a1dfe5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:12.502310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:12.503040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:12.503378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:12.503656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:12.504410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:12.506309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:12.669429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 946/1869] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:12 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:12.673544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:12.689567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7dbe4-ce03-47c7-bd13-4fc6559c4fab admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:12.811908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:12.812590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:12.813012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:12.813482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:12.814624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:12.818007 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:12.964958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 924/1870] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:12 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:12.980932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:12.999540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124121-a3b6-46ab-bdbf-252d55a26553 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.016526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.017248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.017722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.018002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.018794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.020617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.042202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 947/1871] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:13.047053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:13.057596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a26bf5-de13-4837-a4ec-554ced66c34e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.062664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.063637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.064068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.064490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.065468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.067412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.078441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 925/1872] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:13.084180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:13.099202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df8d50-28a2-467d-950a-b56b86254c4a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.104767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaa573-a181-494e-962c-69149b8145f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.105673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaa573-a181-494e-962c-69149b8145f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.105953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaa573-a181-494e-962c-69149b8145f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.106398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaa573-a181-494e-962c-69149b8145f3 admin admin] PATH_INFO: `/v3/projects/e81a7673edbf4ac888426b3698d73a67/users/407d119f1c324ab189d13931b179c550/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.123602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaa573-a181-494e-962c-69149b8145f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81a7673edbf4ac888426b3698d73a67, user_id=407d119f1c324ab189d13931b179c550, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.131796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deaa573-a181-494e-962c-69149b8145f3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.171793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:13.175266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:13.198301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ad31-1688-4b6a-b38d-35dc9806934e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.206920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.208437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.208947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.209446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] PATH_INFO: `/v3/projects/7979789dcc9a4c5da2842844f6de9318` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.211623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7979789dcc9a4c5da2842844f6de9318)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.215367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.301707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 948/1873] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:13 2022] PUT /identity/v3/projects/e81a7673edbf4ac888426b3698d73a67/users/407d119f1c324ab189d13931b179c550/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:13.318454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ca67-fca9-4907-9c68-4f3cdb677faa None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.318783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ca67-fca9-4907-9c68-4f3cdb677faa None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.319227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ca67-fca9-4907-9c68-4f3cdb677faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.357217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6576ca67-fca9-4907-9c68-4f3cdb677faa None None] MFA Rules not processed for user `407d119f1c324ab189d13931b179c550`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:13.358489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6576ca67-fca9-4907-9c68-4f3cdb677faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:13.397805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7979789dcc9a4c5da2842844f6de9318', 'request_id': 'req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:13.405168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7979789dcc9a4c5da2842844f6de9318', 'request_id': 'req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:13.460265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 949/1874] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:13.463754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576ca67-fca9-4907-9c68-4f3cdb677faa None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:13.487428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7979789dcc9a4c5da2842844f6de9318', 'request_id': 'req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:13.508489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] The token cache is being invalidate because project 7979789dcc9a4c5da2842844f6de9318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:13.508916 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:13.509670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3c1eaad2-3adb-4693-9e7f-4a7de06aa899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:13.514774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 926/1875] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:13 2022] DELETE /identity/v3/projects/7979789dcc9a4c5da2842844f6de9318 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:13.519434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ada03-6307-4a62-a3bc-8967ad5743c3 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.519890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ada03-6307-4a62-a3bc-8967ad5743c3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.520491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ada03-6307-4a62-a3bc-8967ad5743c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.536376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576ca67-fca9-4907-9c68-4f3cdb677faa None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.549212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3c7ada03-6307-4a62-a3bc-8967ad5743c3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:13.551577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3c7ada03-6307-4a62-a3bc-8967ad5743c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:13.612958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.613869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.614755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.615585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.616706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.619108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.641017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 927/1876] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:13.643686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc3a4-251a-4e4b-98b6-d7729300fa92 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.644050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc3a4-251a-4e4b-98b6-d7729300fa92 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.644399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc3a4-251a-4e4b-98b6-d7729300fa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.664126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-555bc3a4-251a-4e4b-98b6-d7729300fa92 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:13.665416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-555bc3a4-251a-4e4b-98b6-d7729300fa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:13.677970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 928/1877] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:13.679160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc3a4-251a-4e4b-98b6-d7729300fa92 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:13.691389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc3a4-251a-4e4b-98b6-d7729300fa92 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.696978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.697920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.698544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.698887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.699637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:13.699949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.701795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.719953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 929/1878] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:13.720948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:13.731151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6684-f842-40ad-bef4-102adad9ca60 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.736357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.737008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.737289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.737587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.738288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.740289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.767699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 950/1879] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:13 2022] POST /identity/v3/projects => generated 379 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:13.773756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:13.775706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:13.889485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb73b5-0998-4f65-b755-f7588b3bae14 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:13.894375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:13.895078 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:13.895357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:13.895632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:13.896347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:13.898384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:13.931668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 930/1880] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:13 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:13.933238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.008578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcbfe6-29db-49d9-aaa2-3c58a6c25a92 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.018099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.018863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.019180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.019452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.020218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.022273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.049136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 951/1881] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:13 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:14.054719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.072757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bf61e-e2ff-476f-8158-cee8e1634e9d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.079409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.079409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.079409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.079825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.080761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.082389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.100288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 952/1882] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:14.101446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.112592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66137f-e746-49e8-9203-9309bd536999 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.117438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.118336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.118825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.119106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] PATH_INFO: `/v3/projects/d705569d687a4395aa3ef1b35caac537/users/c9189a39f5ee40f69ffab3908a3b7d26/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.137527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d705569d687a4395aa3ef1b35caac537, user_id=c9189a39f5ee40f69ffab3908a3b7d26, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.141563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.199218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 931/1883] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:13 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:14.215191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.225259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6014f5-785c-48fe-959c-7ee1a396ee4e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.230410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.231115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.231493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.231688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.234189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.234550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.250767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 932/1884] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:14.255315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.266790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffcc7b-dec2-490c-80dd-d412fdf5e132 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.271781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.272466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.272752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.273033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.273791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.275630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.289978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 933/1885] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:14.294064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.302218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 953/1886] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:14 2022] PUT /identity/v3/projects/d705569d687a4395aa3ef1b35caac537/users/c9189a39f5ee40f69ffab3908a3b7d26/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:14.306102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7093f9-8efa-47a5-b58f-b221aba272c4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.306886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.388612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b36bf-56c8-4a69-bca1-5160bc043a99 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.389368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef6760-683e-46ee-8e28-b7a9dc52ef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.390831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6760-683e-46ee-8e28-b7a9dc52ef57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.391359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6760-683e-46ee-8e28-b7a9dc52ef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.391854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6760-683e-46ee-8e28-b7a9dc52ef57 admin admin] PATH_INFO: `/v3/projects/909604e8d5bf4d8c8567c8c5c478095f/users/bb0deb70a04443e6979b0bdbbfa64999/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.394598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.395593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.395973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.396338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.397413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.399376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.409469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef6760-683e-46ee-8e28-b7a9dc52ef57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909604e8d5bf4d8c8567c8c5c478095f, user_id=bb0deb70a04443e6979b0bdbbfa64999, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.415118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 954/1887] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:14.415300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef6760-683e-46ee-8e28-b7a9dc52ef57 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.419989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.432373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8e062-f979-4c9b-b057-775423281904 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.438281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bba6f-e93c-4871-a145-1b236a3980df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.439240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bba6f-e93c-4871-a145-1b236a3980df admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.439523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bba6f-e93c-4871-a145-1b236a3980df admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.441108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bba6f-e93c-4871-a145-1b236a3980df admin admin] PATH_INFO: `/v3/projects/d705569d687a4395aa3ef1b35caac537/users/c9189a39f5ee40f69ffab3908a3b7d26/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.442310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bba6f-e93c-4871-a145-1b236a3980df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d705569d687a4395aa3ef1b35caac537, user_id=c9189a39f5ee40f69ffab3908a3b7d26, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.445370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bba6f-e93c-4871-a145-1b236a3980df admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.468987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 955/1888] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:14 2022] PUT /identity/v3/projects/d705569d687a4395aa3ef1b35caac537/users/c9189a39f5ee40f69ffab3908a3b7d26/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:14.470964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.471261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.471692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.518890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] MFA Rules not processed for user `c9189a39f5ee40f69ffab3908a3b7d26`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:14.520962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:14.534221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 934/1889] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:14 2022] PUT /identity/v3/projects/909604e8d5bf4d8c8567c8c5c478095f/users/bb0deb70a04443e6979b0bdbbfa64999/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:14.549217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28080c15-34d7-41a6-b119-37208b391755 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.549507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28080c15-34d7-41a6-b119-37208b391755 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.549782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28080c15-34d7-41a6-b119-37208b391755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.601163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-28080c15-34d7-41a6-b119-37208b391755 None None] MFA Rules not processed for user `bb0deb70a04443e6979b0bdbbfa64999`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:14.603993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-28080c15-34d7-41a6-b119-37208b391755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:14.645756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 956/1890] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:14.657657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.659927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:14.732886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0bf6-4886-4dec-b80c-9d8c3bda1165 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.734895 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 935/1891] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:14.739185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.739346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28080c15-34d7-41a6-b119-37208b391755 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:14.740022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.740308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.740728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.753948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.755556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:14.770654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 957/1892] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:14.873795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28080c15-34d7-41a6-b119-37208b391755 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:14.880021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:14.880698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:14.880982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:14.881257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:14.881971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:14.883955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:15.139195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 936/1893] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:14 2022] POST /identity/v3/projects => generated 379 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:15.140407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:15.175156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33694d51-fb2c-4202-b1fa-e4ac0e3e2725 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:15.264445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:15.322483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:15.322483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:15.322483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:15.322483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:15.322483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:16.485719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 958/1894] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:15 2022] POST /identity/v3/users => generated 290 bytes in 1349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:16.487719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:16.497466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e755d-f06a-4ab0-a074-03dd9790cb03 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:16.503415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:16.504177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:16.504553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:16.504895 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:16.505716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:16.507793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:16.519787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 937/1895] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:16.523951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:16.534218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638fd1-4582-4168-90b7-b6dc5ba46cae admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:16.538953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:16.539607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:16.539888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:16.540161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:16.540916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:16.542507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:16.552245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 959/1896] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:16.556350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:16.565959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d306-678d-4b70-b4ed-0ed37ad07cf8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:16.570423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade641d7-c8f7-42e9-a230-24b562f1d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:16.571320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade641d7-c8f7-42e9-a230-24b562f1d18d admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:16.579846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade641d7-c8f7-42e9-a230-24b562f1d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:16.579846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade641d7-c8f7-42e9-a230-24b562f1d18d admin admin] PATH_INFO: `/v3/projects/29ebae46a3824df1aff3ce03c1115a61/users/39ce000aa98440cbbe5dd47c6e7fc80a/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:16.586294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade641d7-c8f7-42e9-a230-24b562f1d18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ebae46a3824df1aff3ce03c1115a61, user_id=39ce000aa98440cbbe5dd47c6e7fc80a, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:16.588913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade641d7-c8f7-42e9-a230-24b562f1d18d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:16.701398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 938/1897] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:16 2022] PUT /identity/v3/projects/29ebae46a3824df1aff3ce03c1115a61/users/39ce000aa98440cbbe5dd47c6e7fc80a/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:16.713943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:16.714849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b24984-cf3c-4e63-a9a8-ae27bc88dd4e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:16.715145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b24984-cf3c-4e63-a9a8-ae27bc88dd4e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:16.715424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b24984-cf3c-4e63-a9a8-ae27bc88dd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:16.715729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:16.728803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32696d91-0c7e-40d9-ad80-45aee2d21226 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:16.743120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-98b24984-cf3c-4e63-a9a8-ae27bc88dd4e None None] MFA Rules not processed for user `39ce000aa98440cbbe5dd47c6e7fc80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:16.744970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-98b24984-cf3c-4e63-a9a8-ae27bc88dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:16.785591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:16.786553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:16.786869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:16.787140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] PATH_INFO: `/v3/users/f1638785cf554b629aa40f0094e00358` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:16.788416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1638785cf554b629aa40f0094e00358)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:16.790338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:16.809235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 939/1898] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:16.814262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b24984-cf3c-4e63-a9a8-ae27bc88dd4e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:16.824427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b24984-cf3c-4e63-a9a8-ae27bc88dd4e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:16.829621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:16.830259 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:16.830544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:16.830851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:16.831548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:16.833483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.025523 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 940/1899] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:16 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:17.029703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.089935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9385-a2e6-4972-bd07-0726452ecd09 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.094962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.095626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.095903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.096170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.096898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.098861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.148280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1638785cf554b629aa40f0094e00358'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:17.155162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1638785cf554b629aa40f0094e00358'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:17.230010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 941/1900] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:17 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:17.234570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.244317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867f4c-7f14-4c4d-a399-47a2adf22f56 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.250098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.250777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.251063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.251334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.252101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.253694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.263674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 942/1901] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:17.267833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.277505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7058-304b-4216-b96d-7d0e53e21d35 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.282297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.283220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.283503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.283783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] PATH_INFO: `/v3/projects/ffae3a85329c42eda01cdd70c3c75c74/users/7a6ee05542934d13a022ab4af1f80d5d/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.292427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1638785cf554b629aa40f0094e00358'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:17.293100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1638785cf554b629aa40f0094e00358'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:17.299386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffae3a85329c42eda01cdd70c3c75c74, user_id=7a6ee05542934d13a022ab4af1f80d5d, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.302463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.308151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-23215941-aab3-4dfe-a148-580dfb084949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1638785cf554b629aa40f0094e00358'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:17.314846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 960/1902] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:16 2022] DELETE /identity/v3/users/f1638785cf554b629aa40f0094e00358 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:17.319988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.320273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.320546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.345765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:17.347286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:17.417447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 961/1903] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:17.418433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.419775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:17.427282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 943/1904] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:17 2022] PUT /identity/v3/projects/ffae3a85329c42eda01cdd70c3c75c74/users/7a6ee05542934d13a022ab4af1f80d5d/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:17.430931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.432758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:17.501441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f8003-90f3-452a-83f0-714f4d713cc4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.525177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf4b1-0ebc-4f5c-80ef-cef3e074af92 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.532008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.533676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.534201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.534691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.535687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.538145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.554774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 944/1905] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:17.554774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.556029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:17.567487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9189a39f5ee40f69ffab3908a3b7d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd705569d687a4395aa3ef1b35caac537', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.568177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.568548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.568832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.569572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:17.569880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.571514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.583445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 962/1906] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:17.584078 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.594760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d60c8-c16c-486e-a9d6-b6c91f927c68 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.599439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.600354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.600734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.601015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] PATH_INFO: `/v3/projects/ffae3a85329c42eda01cdd70c3c75c74/users/7a6ee05542934d13a022ab4af1f80d5d/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.603085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffae3a85329c42eda01cdd70c3c75c74, user_id=7a6ee05542934d13a022ab4af1f80d5d, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.605723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.616231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b6e3-3e0c-45b7-b63a-9fbb752ea40b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.616556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 963/1907] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:17 2022] PUT /identity/v3/projects/ffae3a85329c42eda01cdd70c3c75c74/users/7a6ee05542934d13a022ab4af1f80d5d/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:17.617425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.671152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b508-ab9c-4af6-956c-a2f1e68c732a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.671804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b508-ab9c-4af6-956c-a2f1e68c732a service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.672082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b508-ab9c-4af6-956c-a2f1e68c732a service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.672363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b508-ab9c-4af6-956c-a2f1e68c732a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.682540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d797a2-8fab-4b51-bc62-6e9297c0285d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.687773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9189a39f5ee40f69ffab3908a3b7d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd705569d687a4395aa3ef1b35caac537', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.688424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.688711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.688994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.689702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.691636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.729961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b508-ab9c-4af6-956c-a2f1e68c732a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.731425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b508-ab9c-4af6-956c-a2f1e68c732a service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.741205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 945/1908] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:17.742585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.742905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.743184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.769087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] MFA Rules not processed for user `7a6ee05542934d13a022ab4af1f80d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:17.770382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:17.787048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 964/1909] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:17 2022] POST /identity/v3/projects => generated 355 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:17.787048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.842572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 946/1910] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:17.853113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.854449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:17.861987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066462c-4a26-4061-9bbb-046c9d5d7e04 tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.867100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9189a39f5ee40f69ffab3908a3b7d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd705569d687a4395aa3ef1b35caac537', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.872347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.872347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.872347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.872347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:17.872347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.873013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.883091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 965/1911] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:17.909511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d87e9-c646-4831-8ca6-a15c8c80ee87 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.916786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:17.927140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7cdd0-7428-4da8-b2a3-349a8da4929b tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:17.931798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9189a39f5ee40f69ffab3908a3b7d26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd705569d687a4395aa3ef1b35caac537', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.932642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.932926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.933277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] PATH_INFO: `/v3/projects/bf32016f99d849469ba51cced75cde73` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:17.934463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf32016f99d849469ba51cced75cde73)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:17.936425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:17.956516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:17.957203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:17.957473 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:17.957748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:18.020119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:18.021556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:18.031691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 947/1912] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:18.106392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf32016f99d849469ba51cced75cde73', 'request_id': 'req-427ad3d5-381c-4b14-b4cf-240be73adb2f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.112499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf32016f99d849469ba51cced75cde73', 'request_id': 'req-427ad3d5-381c-4b14-b4cf-240be73adb2f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.262706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:18.264253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:18.276075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae384034-3593-4b59-812d-ddf676a241ce service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:18.277935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf32016f99d849469ba51cced75cde73', 'request_id': 'req-427ad3d5-381c-4b14-b4cf-240be73adb2f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.291839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] The token cache is being invalidate because project bf32016f99d849469ba51cced75cde73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:18.291839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.292568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.294268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 966/1913] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:17 2022] DELETE /identity/v3/projects/bf32016f99d849469ba51cced75cde73 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:18.294998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:18.296381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:18.353063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:18.354016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:18.354366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:18.354587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:18.356471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:18.369509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad3d5-381c-4b14-b4cf-240be73adb2f tempest-VolumeQuotaClassesTest-171297925 tempest-VolumeQuotaClassesTest-171297925-project-admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:18.375197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:18.376247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:18.382099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:18.382099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] PATH_INFO: `/v3/projects/5d042fdceea14585ad9c27eabd786c3a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:18.382099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d042fdceea14585ad9c27eabd786c3a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:18.383778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:18.418775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:18.420059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:18.429206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 948/1914] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:18.507265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d042fdceea14585ad9c27eabd786c3a', 'request_id': 'req-e1e79f5d-25ff-485f-8b78-4a82ada878e8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.516380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d042fdceea14585ad9c27eabd786c3a', 'request_id': 'req-e1e79f5d-25ff-485f-8b78-4a82ada878e8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.620801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d042fdceea14585ad9c27eabd786c3a', 'request_id': 'req-e1e79f5d-25ff-485f-8b78-4a82ada878e8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.634754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] The token cache is being invalidate because project 5d042fdceea14585ad9c27eabd786c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:18.635051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.640979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:18.644757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 967/1915] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:18 2022] DELETE /identity/v3/projects/5d042fdceea14585ad9c27eabd786c3a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:18.651608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:18.663653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8259af4-f8d4-46c2-8382-8b25e8fb798a service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:18.735582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:18.736455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:18.736738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:18.737008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] PATH_INFO: `/v3/users/af9fd15cef5e49c584bb0bff3ac3519f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:18.738218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9fd15cef5e49c584bb0bff3ac3519f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:18.744239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:18.957828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:18.959254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:18.971641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e79f5d-25ff-485f-8b78-4a82ada878e8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:18.976608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:18.977471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:18.977752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:18.978024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] PATH_INFO: `/v3/users/407d119f1c324ab189d13931b179c550` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:18.979710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407d119f1c324ab189d13931b179c550)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:18.981692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:19.021581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9fd15cef5e49c584bb0bff3ac3519f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.028052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9fd15cef5e49c584bb0bff3ac3519f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.028709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9fd15cef5e49c584bb0bff3ac3519f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.231654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9fd15cef5e49c584bb0bff3ac3519f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.243372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-33b911fe-5463-47f7-bc18-9f6750ec19ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9fd15cef5e49c584bb0bff3ac3519f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.249819 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 949/1916] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:18 2022] DELETE /identity/v3/users/af9fd15cef5e49c584bb0bff3ac3519f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:19.417226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407d119f1c324ab189d13931b179c550'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.424657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407d119f1c324ab189d13931b179c550'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.549665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407d119f1c324ab189d13931b179c550'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.550683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407d119f1c324ab189d13931b179c550'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.578510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407d119f1c324ab189d13931b179c550'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:19.586354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 968/1917] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:18 2022] DELETE /identity/v3/users/407d119f1c324ab189d13931b179c550 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:19.591427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:19.591570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:19.591820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:19.610784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:19.612044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:19.700946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 950/1918] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:19.704554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:19.706033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:19.808394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bfa3-3a1f-4ae4-8174-5a6dc9d251b6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:19.814106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22476e-bef8-429f-928a-f9f16dc22b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:19.814677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22476e-bef8-429f-928a-f9f16dc22b42 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:19.823936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22476e-bef8-429f-928a-f9f16dc22b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:19.825730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22476e-bef8-429f-928a-f9f16dc22b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:19.837702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22476e-bef8-429f-928a-f9f16dc22b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:19.839195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22476e-bef8-429f-928a-f9f16dc22b42 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:19.855215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 969/1919] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:19.914221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:19.915890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:19.938403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63bb79-6b78-47d1-8b69-bfd816c51d82 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:19.944502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:19.945369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:19.945768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:19.946107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] PATH_INFO: `/v3/projects/a8de23a749054fcbb464604aaa40429e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:19.947278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8de23a749054fcbb464604aaa40429e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:19.949243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.144018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8de23a749054fcbb464604aaa40429e', 'request_id': 'req-d9c74937-7111-4d46-806e-9e757d991a41'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.150619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8de23a749054fcbb464604aaa40429e', 'request_id': 'req-d9c74937-7111-4d46-806e-9e757d991a41'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.214667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8de23a749054fcbb464604aaa40429e', 'request_id': 'req-d9c74937-7111-4d46-806e-9e757d991a41'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.226911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] The token cache is being invalidate because project a8de23a749054fcbb464604aaa40429e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:20.227200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.227842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d9c74937-7111-4d46-806e-9e757d991a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.229472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 951/1920] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:19 2022] DELETE /identity/v3/projects/a8de23a749054fcbb464604aaa40429e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:20.235453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.236504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.237075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.258095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:20.259450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:20.318138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 970/1921] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:20.326188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32472-6a9b-410d-87a4-2dbd272a0a6d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.326478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32472-6a9b-410d-87a4-2dbd272a0a6d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.326785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32472-6a9b-410d-87a4-2dbd272a0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.345932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f2e32472-6a9b-410d-87a4-2dbd272a0a6d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:20.346832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.347354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f2e32472-6a9b-410d-87a4-2dbd272a0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:20.348235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:20.362179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae07c-5d78-42ca-a33d-3429b748b9ea None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.367173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.368044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.368324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.368601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] PATH_INFO: `/v3/projects/e81a7673edbf4ac888426b3698d73a67` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.369827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81a7673edbf4ac888426b3698d73a67)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.372162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.381421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 952/1922] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:20.382176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32472-6a9b-410d-87a4-2dbd272a0a6d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.407535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32472-6a9b-410d-87a4-2dbd272a0a6d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.412490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.413240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.413521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.413794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.414751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:20.414854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.416440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.433138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 953/1923] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:20.438101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.448139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130d1c-d8dd-4307-8859-dc68a3d32da5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.453394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.454182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.454358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.454644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.455482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.457480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.517476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81a7673edbf4ac888426b3698d73a67', 'request_id': 'req-91d4ff85-99a3-4057-b07d-4e3e104d8e20'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.522900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81a7673edbf4ac888426b3698d73a67', 'request_id': 'req-91d4ff85-99a3-4057-b07d-4e3e104d8e20'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.614832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 954/1924] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:20 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:20.618763 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.642613 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81a7673edbf4ac888426b3698d73a67', 'request_id': 'req-91d4ff85-99a3-4057-b07d-4e3e104d8e20'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.654400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] The token cache is being invalidate because project e81a7673edbf4ac888426b3698d73a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:20.654632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.655830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:20.657386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 971/1925] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:20 2022] DELETE /identity/v3/projects/e81a7673edbf4ac888426b3698d73a67 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:20.661228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.662531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:20.678401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf6a1-ac8f-462f-8c1c-833fd743dc8d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.683142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.683792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.684078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.684357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.685076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.687025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.727734 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4ff85-99a3-4057-b07d-4e3e104d8e20 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.732551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.737321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.737321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.737321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] PATH_INFO: `/v3/users/c9189a39f5ee40f69ffab3908a3b7d26` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.737321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9189a39f5ee40f69ffab3908a3b7d26)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.737785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.803442 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 955/1926] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:20 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:20.807546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.809169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:20.821436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ca5c-ad60-4df9-a7ee-904e9f8923eb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.826289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.827053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.827985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.828446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.829190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.830903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.844266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 956/1927] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:20.846549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.856084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024866-1bae-4ea4-a0de-b853d93c0e49 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.861012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.861826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.862043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.862318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.863096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.865347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:20.879978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 957/1928] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:20.880912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:20.891618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a85b-bec6-435d-984c-0e29f648c763 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:20.909600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ee6e1-b93b-4848-9317-e490b3b8186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:20.910510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ee6e1-b93b-4848-9317-e490b3b8186e admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:20.910824 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ee6e1-b93b-4848-9317-e490b3b8186e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:20.911103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ee6e1-b93b-4848-9317-e490b3b8186e admin admin] PATH_INFO: `/v3/projects/58f9746367c342c4a916154a48ce4d59/users/1f3aca7cd838490fa8a52d42a540fb60/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:20.927317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ee6e1-b93b-4848-9317-e490b3b8186e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f9746367c342c4a916154a48ce4d59, user_id=1f3aca7cd838490fa8a52d42a540fb60, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:20.932576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ee6e1-b93b-4848-9317-e490b3b8186e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:21.021796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9189a39f5ee40f69ffab3908a3b7d26'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:21.029123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9189a39f5ee40f69ffab3908a3b7d26'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:21.060706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 958/1929] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:20 2022] PUT /identity/v3/projects/58f9746367c342c4a916154a48ce4d59/users/1f3aca7cd838490fa8a52d42a540fb60/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:21.063604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153e1a-fefb-45a3-93b7-cd7229685df1 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:21.063604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153e1a-fefb-45a3-93b7-cd7229685df1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:21.063604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38153e1a-fefb-45a3-93b7-cd7229685df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:21.080003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-38153e1a-fefb-45a3-93b7-cd7229685df1 None None] MFA Rules not processed for user `f12d89fe1feb44c094e1321c41deac60`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:21.081374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-38153e1a-fefb-45a3-93b7-cd7229685df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:21.134350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 959/1930] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:21.135901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cdd8d-d3d7-410d-b8f5-12e097ebf94a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:21.136190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cdd8d-d3d7-410d-b8f5-12e097ebf94a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:21.136469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cdd8d-d3d7-410d-b8f5-12e097ebf94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:21.158313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9189a39f5ee40f69ffab3908a3b7d26'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:21.159448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9189a39f5ee40f69ffab3908a3b7d26'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:21.167789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-9f6cdd8d-d3d7-410d-b8f5-12e097ebf94a None None] MFA Rules not processed for user `1f3aca7cd838490fa8a52d42a540fb60`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:21.168809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9f6cdd8d-d3d7-410d-b8f5-12e097ebf94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:21.176116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9189a39f5ee40f69ffab3908a3b7d26'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:21.182795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 972/1931] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:20 2022] DELETE /identity/v3/users/c9189a39f5ee40f69ffab3908a3b7d26 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:21.237852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 960/1932] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:21.242409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:21.243829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:21.306955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9bea4-d9be-45f4-9f42-cc62bf18d00a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:21.312232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:21.312892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:21.313176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:21.313449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:21.314153 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:21.316111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:21.422113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 973/1933] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:21 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:21.426394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cdd8d-d3d7-410d-b8f5-12e097ebf94a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:21.491680 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cdd8d-d3d7-410d-b8f5-12e097ebf94a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:21.555393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:21.556954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:21.557243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:21.557517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:21.558285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:21.560876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:21.709321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 961/1934] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:21 2022] POST /identity/v3/users => generated 299 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:21.711036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:21.721946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b42fe-4eef-4170-9fe9-2c8eb676818b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:21.726418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:21.727170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:21.727399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:21.727668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:21.733448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:21.733448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:21.736618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:21.738481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:21.744900 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 974/1935] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:21.746015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:21.753143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb35ce-1957-43d1-ad8b-af260a4a9441 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:21.759103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:21.760138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:21.760415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:21.760722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bcd80-6c1e-4cd7-92a6-3b9486cb9031 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:21.760816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] PATH_INFO: `/v3/projects/d705569d687a4395aa3ef1b35caac537` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:21.761920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d705569d687a4395aa3ef1b35caac537)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:21.773487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:21.776676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:21.777987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:21.778355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:21.778827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] PATH_INFO: `/v3/projects/40be84fe178a4be18eb31ac6b87e585d/users/924ce2cbe70b4ebcb577685ddac2be23/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:21.808490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40be84fe178a4be18eb31ac6b87e585d, user_id=924ce2cbe70b4ebcb577685ddac2be23, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:21.811371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:22.232798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 975/1936] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:21 2022] PUT /identity/v3/projects/40be84fe178a4be18eb31ac6b87e585d/users/924ce2cbe70b4ebcb577685ddac2be23/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:22.232987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd705569d687a4395aa3ef1b35caac537', 'request_id': 'req-45392f45-1783-42e4-95e5-6cd952ae79ee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:22.232987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd705569d687a4395aa3ef1b35caac537', 'request_id': 'req-45392f45-1783-42e4-95e5-6cd952ae79ee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:22.243998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:22.294675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50832-d91d-4f4e-8978-ac689321b85c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:22.351433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:22.352108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.352392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.352667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.353405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:22.355031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:22.364645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 976/1937] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:22.368992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:22.379306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f9ec5-8ac8-4b9d-8cfc-b4aa4e37c557 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:22.383831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a028c08-921a-44ff-96cb-36d5499c1a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:22.384674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028c08-921a-44ff-96cb-36d5499c1a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.384950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028c08-921a-44ff-96cb-36d5499c1a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.385220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028c08-921a-44ff-96cb-36d5499c1a63 admin admin] PATH_INFO: `/v3/projects/40be84fe178a4be18eb31ac6b87e585d/users/924ce2cbe70b4ebcb577685ddac2be23/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.387214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a028c08-921a-44ff-96cb-36d5499c1a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40be84fe178a4be18eb31ac6b87e585d, user_id=924ce2cbe70b4ebcb577685ddac2be23, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:22.389874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a028c08-921a-44ff-96cb-36d5499c1a63 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:22.399606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 977/1938] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:22 2022] PUT /identity/v3/projects/40be84fe178a4be18eb31ac6b87e585d/users/924ce2cbe70b4ebcb577685ddac2be23/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:22.410433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.410717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.411015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.443211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] MFA Rules not processed for user `924ce2cbe70b4ebcb577685ddac2be23`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:22.448350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:22.449811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd705569d687a4395aa3ef1b35caac537', 'request_id': 'req-45392f45-1783-42e4-95e5-6cd952ae79ee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:22.474694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] The token cache is being invalidate because project d705569d687a4395aa3ef1b35caac537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:22.475012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:22.488776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45392f45-1783-42e4-95e5-6cd952ae79ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:22.488776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 962/1939] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:21 2022] DELETE /identity/v3/projects/d705569d687a4395aa3ef1b35caac537 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:22.493642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f369b-6ff1-4543-93a3-e83d1387f6a5 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.494219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f369b-6ff1-4543-93a3-e83d1387f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.494630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f369b-6ff1-4543-93a3-e83d1387f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.514960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8c7f369b-6ff1-4543-93a3-e83d1387f6a5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:22.516264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8c7f369b-6ff1-4543-93a3-e83d1387f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:22.519644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 978/1940] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:22.528489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:22.529802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:22.574068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 963/1941] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:22.581480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9b399-8d34-4d5d-aac2-9ccea1f4e646 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.581860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9b399-8d34-4d5d-aac2-9ccea1f4e646 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.582169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9b399-8d34-4d5d-aac2-9ccea1f4e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.583409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dfbf4-a4d3-47d9-9082-0bc0987d7f2f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:22.587054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:22.587694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.587974 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.588248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.590010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:22.599538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dfa9b399-8d34-4d5d-aac2-9ccea1f4e646 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:22.600686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dfa9b399-8d34-4d5d-aac2-9ccea1f4e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:22.609592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 964/1942] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:22.613747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9b399-8d34-4d5d-aac2-9ccea1f4e646 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:22.623480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9b399-8d34-4d5d-aac2-9ccea1f4e646 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:22.628958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:22.631827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.631827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.631827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.631827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:22.631827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:22.632840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:22.644367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 965/1943] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:54:22.647405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:22.648551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:22.649033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:22.657972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f6c2e-6262-4bbb-8303-63e26f7b963f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:22.658442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 979/1944] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:22.663307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:22.663943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.664225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.664772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.665587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:22.667503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:22.804684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 966/1945] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:22 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:22.808871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:22.821948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537789a-9654-431e-a7d5-a9018d5a2516 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:22.878886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:22.879563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:22.879854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:22.880123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:22.880832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:22.883016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:23.058469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 980/1946] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:22 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:23.059745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:23.070165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec6c9-9e46-4a9b-b1fa-172043b10dda admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:23.074859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:23.075602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.075884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.076161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.076895 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:23.078494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:23.088347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 967/1947] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:23.093755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:23.104444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42296d8b-9628-4f14-ae30-fb0033476562 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:23.110454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73941f-a6d0-46f6-84e2-eda61c104e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:23.111270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73941f-a6d0-46f6-84e2-eda61c104e55 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.111652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73941f-a6d0-46f6-84e2-eda61c104e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.112027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73941f-a6d0-46f6-84e2-eda61c104e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.112844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73941f-a6d0-46f6-84e2-eda61c104e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:23.114688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73941f-a6d0-46f6-84e2-eda61c104e55 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:23.127456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 981/1948] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:23.131773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:23.143161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85746ff-a0a1-4d3a-9dbd-db35e2a8018e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:23.149814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:23.150921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.151088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.151351 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] PATH_INFO: `/v3/projects/f8dc41b46bc0402b9b900f59719afcf3/users/1516bbf6eebb4001a206f34db5e9bd19/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.167521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8dc41b46bc0402b9b900f59719afcf3, user_id=1516bbf6eebb4001a206f34db5e9bd19, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:23.172220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:23.345648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 968/1949] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:23 2022] PUT /identity/v3/projects/f8dc41b46bc0402b9b900f59719afcf3/users/1516bbf6eebb4001a206f34db5e9bd19/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:23.354453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7767-1718-4ab7-b88c-48d258fee544 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.354750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7767-1718-4ab7-b88c-48d258fee544 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.355364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7767-1718-4ab7-b88c-48d258fee544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.394379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-36fb7767-1718-4ab7-b88c-48d258fee544 None None] MFA Rules not processed for user `1516bbf6eebb4001a206f34db5e9bd19`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:23.396155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-36fb7767-1718-4ab7-b88c-48d258fee544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:23.458756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 982/1950] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:23.463199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:23.522809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f71c55-2186-4bb6-931f-a96fbf361a6f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:23.527478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:23.528127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.528412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.528686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.529375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:23.531344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:23.681998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 969/1951] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:23 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:23.683666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7767-1718-4ab7-b88c-48d258fee544 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:23.694911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7767-1718-4ab7-b88c-48d258fee544 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:23.750314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:23.751023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.751305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.751578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.752284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:23.754236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:23.913452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 983/1952] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:23 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:23.917435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:23.927775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283439eb-f46b-4af0-8e17-4f4648542871 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:23.934426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:23.935171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.935454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.935728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.936615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:23.938239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:23.949808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 970/1953] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:23.954338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:23.964920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7495c-2b1e-4359-a86b-084fbf8878b3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:23.970533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:23.971456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:23.971739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:23.972016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] PATH_INFO: `/v3/projects/3268fdfa91f74dea92c162a73a78b32c/users/2615b999504748258ef5e4aada6e2d8f/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:23.988360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3268fdfa91f74dea92c162a73a78b32c, user_id=2615b999504748258ef5e4aada6e2d8f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:23.991040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:24.221030 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 984/1954] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:23 2022] PUT /identity/v3/projects/3268fdfa91f74dea92c162a73a78b32c/users/2615b999504748258ef5e4aada6e2d8f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:24.225051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:24.236074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fba88-e6fa-461d-b2a0-df2a5a10ffaf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:24.297809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8db11-c826-4253-8d4d-cccb766ab1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:24.298487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8db11-c826-4253-8d4d-cccb766ab1aa admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:24.298802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8db11-c826-4253-8d4d-cccb766ab1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:24.299085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8db11-c826-4253-8d4d-cccb766ab1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:24.299849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8db11-c826-4253-8d4d-cccb766ab1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:24.301436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8db11-c826-4253-8d4d-cccb766ab1aa admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:24.311638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 971/1955] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:24.322090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:24.332817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58fa4-7a4a-4000-be7b-ea2f569fd031 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:24.337641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:24.338723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:24.339063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:24.339300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] PATH_INFO: `/v3/projects/3268fdfa91f74dea92c162a73a78b32c/users/2615b999504748258ef5e4aada6e2d8f/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:24.341338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3268fdfa91f74dea92c162a73a78b32c, user_id=2615b999504748258ef5e4aada6e2d8f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:24.344488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:24.354894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 985/1956] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:24 2022] PUT /identity/v3/projects/3268fdfa91f74dea92c162a73a78b32c/users/2615b999504748258ef5e4aada6e2d8f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:24.366923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5bc4-74e4-4374-a63c-2a505ac8cfa0 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:24.367450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5bc4-74e4-4374-a63c-2a505ac8cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:24.375590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5bc4-74e4-4374-a63c-2a505ac8cfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:24.395872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-ccdd5bc4-74e4-4374-a63c-2a505ac8cfa0 None None] MFA Rules not processed for user `2615b999504748258ef5e4aada6e2d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:24.397055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ccdd5bc4-74e4-4374-a63c-2a505ac8cfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:24.469917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 972/1957] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:24.479522 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:24.536496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc7da-5f93-4127-9561-d214a0a23699 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:24.540114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:24.540757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:24.541030 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:24.541308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:24.550696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:24.552151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:24.562635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 986/1958] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:24.661322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd5bc4-74e4-4374-a63c-2a505ac8cfa0 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:24.670423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd5bc4-74e4-4374-a63c-2a505ac8cfa0 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:24.674853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922c28-7610-48ea-820c-0291faf32fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:24.675489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922c28-7610-48ea-820c-0291faf32fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:24.675909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922c28-7610-48ea-820c-0291faf32fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:24.676187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922c28-7610-48ea-820c-0291faf32fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:24.729720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86922c28-7610-48ea-820c-0291faf32fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:24.731145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86922c28-7610-48ea-820c-0291faf32fe6 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:24.740957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 973/1959] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:25.222707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:25.224708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:25.296121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb88d-9d1f-41ff-a646-092953acfaea service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:25.303446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:25.304461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:25.304839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:25.305211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] PATH_INFO: `/v3/users/bb0deb70a04443e6979b0bdbbfa64999` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:25.306947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0deb70a04443e6979b0bdbbfa64999)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:25.308927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:25.585786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0deb70a04443e6979b0bdbbfa64999'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:25.594441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0deb70a04443e6979b0bdbbfa64999'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:25.744664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0deb70a04443e6979b0bdbbfa64999'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:25.745330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0deb70a04443e6979b0bdbbfa64999'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:25.763924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0deb70a04443e6979b0bdbbfa64999'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:25.775803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 987/1960] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:25 2022] DELETE /identity/v3/users/bb0deb70a04443e6979b0bdbbfa64999 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:25.777218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:25.777679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:25.777797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:25.813239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:25.814443 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:25.901093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 974/1961] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:25.912488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:25.913855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:25.971880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc56c2-c739-4dcd-8c78-20c218f877da admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:25.975544 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:25.976193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:25.976481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:25.976750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:25.985890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:25.987371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:25.998297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 988/1962] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:26.537050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:26.538554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:26.551652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b03690-abec-46b5-9631-bfb3abf2e88d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:26.556907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:26.557964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:26.558302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:26.558677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] PATH_INFO: `/v3/projects/909604e8d5bf4d8c8567c8c5c478095f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:26.560737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909604e8d5bf4d8c8567c8c5c478095f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:26.564332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:26.705121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909604e8d5bf4d8c8567c8c5c478095f', 'request_id': 'req-57d35e0c-bc31-4241-9762-c3080b77de34'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:26.710272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909604e8d5bf4d8c8567c8c5c478095f', 'request_id': 'req-57d35e0c-bc31-4241-9762-c3080b77de34'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:26.768604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909604e8d5bf4d8c8567c8c5c478095f', 'request_id': 'req-57d35e0c-bc31-4241-9762-c3080b77de34'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:26.783627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] The token cache is being invalidate because project 909604e8d5bf4d8c8567c8c5c478095f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:26.784174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:26.784562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:26.786112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 975/1963] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:26 2022] DELETE /identity/v3/projects/909604e8d5bf4d8c8567c8c5c478095f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:26.790189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:26.800939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85a152-5ac8-491a-8c0c-23946281c99d service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:26.876438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:26.877798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:26.878232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:26.878653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] PATH_INFO: `/v3/users/39ce000aa98440cbbe5dd47c6e7fc80a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:26.880091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ce000aa98440cbbe5dd47c6e7fc80a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:26.882176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:27.178763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ce000aa98440cbbe5dd47c6e7fc80a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:27.186125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ce000aa98440cbbe5dd47c6e7fc80a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:27.288730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ce000aa98440cbbe5dd47c6e7fc80a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:27.289970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ce000aa98440cbbe5dd47c6e7fc80a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:27.303610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ce000aa98440cbbe5dd47c6e7fc80a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:27.310124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 989/1964] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:26 2022] DELETE /identity/v3/users/39ce000aa98440cbbe5dd47c6e7fc80a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:27.788318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:27.790246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:27.810438 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d35e0c-bc31-4241-9762-c3080b77de34 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:27.888446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:27.889624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:27.890117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:27.890593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] PATH_INFO: `/v3/projects/29ebae46a3824df1aff3ce03c1115a61` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:27.892225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ebae46a3824df1aff3ce03c1115a61)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:27.894621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:28.042577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ebae46a3824df1aff3ce03c1115a61', 'request_id': 'req-1fa9be63-b904-47e5-bd36-55a219037a5a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.048510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ebae46a3824df1aff3ce03c1115a61', 'request_id': 'req-1fa9be63-b904-47e5-bd36-55a219037a5a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.179887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ebae46a3824df1aff3ce03c1115a61', 'request_id': 'req-1fa9be63-b904-47e5-bd36-55a219037a5a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.191336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] The token cache is being invalidate because project 29ebae46a3824df1aff3ce03c1115a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:28.191629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.192260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.193833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 976/1965] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:27 2022] DELETE /identity/v3/projects/29ebae46a3824df1aff3ce03c1115a61 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:28.197753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:28.199296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:28.214307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c2f2d-0228-471d-8d52-d578347790aa admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:28.273562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:28.274438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:28.274739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:28.275031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] PATH_INFO: `/v3/users/7a6ee05542934d13a022ab4af1f80d5d` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:28.276395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6ee05542934d13a022ab4af1f80d5d)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:28.278368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:28.508465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6ee05542934d13a022ab4af1f80d5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.515741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6ee05542934d13a022ab4af1f80d5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.620215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6ee05542934d13a022ab4af1f80d5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.620870 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6ee05542934d13a022ab4af1f80d5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.633701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6ee05542934d13a022ab4af1f80d5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:28.640070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 990/1966] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:28 2022] DELETE /identity/v3/users/7a6ee05542934d13a022ab4af1f80d5d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:29.197922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:29.199483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:29.212555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9be63-b904-47e5-bd36-55a219037a5a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:29.270291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:29.271525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:29.271918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:29.272457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.272734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.273004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] PATH_INFO: `/v3/users/1516bbf6eebb4001a206f34db5e9bd19` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.274282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1516bbf6eebb4001a206f34db5e9bd19)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:29.276290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:29.285313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18791ae8-4be1-4d1e-8e3e-0945f9d6f8fc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:29.290199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:29.291193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.291486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.291763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] PATH_INFO: `/v3/projects/ffae3a85329c42eda01cdd70c3c75c74` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.293209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffae3a85329c42eda01cdd70c3c75c74)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:29.295233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:29.503878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffae3a85329c42eda01cdd70c3c75c74', 'request_id': 'req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.504068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1516bbf6eebb4001a206f34db5e9bd19'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.509698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffae3a85329c42eda01cdd70c3c75c74', 'request_id': 'req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.510845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1516bbf6eebb4001a206f34db5e9bd19'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.511925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1516bbf6eebb4001a206f34db5e9bd19'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.580303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffae3a85329c42eda01cdd70c3c75c74', 'request_id': 'req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.592696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] The token cache is being invalidate because project ffae3a85329c42eda01cdd70c3c75c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:29.592995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.593956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-79afa5f8-b6c3-4b92-992f-fd5d73a1cc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.595943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 991/1967] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:29 2022] DELETE /identity/v3/projects/ffae3a85329c42eda01cdd70c3c75c74 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:29.602465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e736-7f85-4647-a42f-026fd225f7fa None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.602777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e736-7f85-4647-a42f-026fd225f7fa None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.603057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e736-7f85-4647-a42f-026fd225f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.623183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2c70e736-7f85-4647-a42f-026fd225f7fa None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:29.624420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2c70e736-7f85-4647-a42f-026fd225f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:29.680365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 992/1968] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:29.688561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1516bbf6eebb4001a206f34db5e9bd19'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.690478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7410b3-f740-487d-868d-8494d7f84517 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.690803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7410b3-f740-487d-868d-8494d7f84517 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.691086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7410b3-f740-487d-868d-8494d7f84517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.705239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-6b9729b3-45ee-4a48-8545-27a63def3d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1516bbf6eebb4001a206f34db5e9bd19'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:29.708442 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 977/1969] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:29 2022] DELETE /identity/v3/users/1516bbf6eebb4001a206f34db5e9bd19 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:29.710126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6a7410b3-f740-487d-868d-8494d7f84517 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:29.711653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6a7410b3-f740-487d-868d-8494d7f84517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:29.713131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.713529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.713958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.732391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:29.735225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:29.776539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 993/1970] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:29.781466 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7410b3-f740-487d-868d-8494d7f84517 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:29.790200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7410b3-f740-487d-868d-8494d7f84517 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:29.795415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:29.796572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.796855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.797128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.797905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:29.798175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:29.799721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 978/1971] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:29.799836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:29.811989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 994/1972] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:54:29.814240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:29.816552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:29.816872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:29.826450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978090-626c-455e-9a64-a8c93d5841b1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:29.832161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:29.832817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.833098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.833369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.834065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:29.836051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:29.882697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b09eb6-bf91-4925-bbbc-f1be323347b5 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:29.886504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:29.887227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:29.887593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:29.887871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:29.897608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:29.899100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:29.908768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 979/1973] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:30.037448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 995/1974] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:29 2022] POST /identity/v3/projects => generated 359 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:30.041529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.051545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601ed08-caa5-4467-a9fa-ba0f3f2fefbc service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.107041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.107704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.108501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.108771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.109498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.111448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.228032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 980/1975] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:30 2022] POST /identity/v3/users => generated 280 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:30.232171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.252537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363f697-1342-4ac5-846c-cd0e00766caa admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.258111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.258843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.259085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.259358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.260103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.261685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.272040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 996/1976] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:30.276051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.286353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae233d-34e3-475b-8b57-047e8006e762 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.296053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.296716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.297153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.297609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.298339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.300305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.311192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 981/1977] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:30.315328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.325168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df9e32-beca-4892-b04d-88ae67252119 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.329825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01a848-94ce-44b8-a0cd-547a3911479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.330692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01a848-94ce-44b8-a0cd-547a3911479d admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.331006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01a848-94ce-44b8-a0cd-547a3911479d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.331293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01a848-94ce-44b8-a0cd-547a3911479d admin admin] PATH_INFO: `/v3/projects/4f952daff0a54a4fb8fec55584bf191c/users/23151d7bfc2c4ffcb0eb547e86358933/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.346914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01a848-94ce-44b8-a0cd-547a3911479d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f952daff0a54a4fb8fec55584bf191c, user_id=23151d7bfc2c4ffcb0eb547e86358933, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.349491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01a848-94ce-44b8-a0cd-547a3911479d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.444602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.446337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:30.459815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5ec7-2d5e-4b23-9e99-3754d8b11715 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.468524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 997/1978] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:30 2022] PUT /identity/v3/projects/4f952daff0a54a4fb8fec55584bf191c/users/23151d7bfc2c4ffcb0eb547e86358933/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:30.479811 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.480102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.480377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.509134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] MFA Rules not processed for user `23151d7bfc2c4ffcb0eb547e86358933`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:30.510370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:30.544675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.544675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.544675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.544675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] PATH_INFO: `/v3/projects/f8dc41b46bc0402b9b900f59719afcf3` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.545144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8dc41b46bc0402b9b900f59719afcf3)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.545144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.576712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 998/1979] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:30.605125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.606517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:30.668506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec121ed6-e082-417b-8c2d-dbae4ff7ba86 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.672503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.673146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.673438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.673714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.682437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.683882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.684187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8dc41b46bc0402b9b900f59719afcf3', 'request_id': 'req-2af7d1d8-a57a-47ec-89f1-414f473892d5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:30.689518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8dc41b46bc0402b9b900f59719afcf3', 'request_id': 'req-2af7d1d8-a57a-47ec-89f1-414f473892d5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:30.693345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 999/1980] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:30 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:30.708487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.719457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a655808-1065-460d-bc72-0aeb4193aca5 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.773975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.774907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.775253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.775540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] PATH_INFO: `/v3/users/23151d7bfc2c4ffcb0eb547e86358933` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.776765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=23151d7bfc2c4ffcb0eb547e86358933)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.778833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.820006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8dc41b46bc0402b9b900f59719afcf3', 'request_id': 'req-2af7d1d8-a57a-47ec-89f1-414f473892d5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:30.820203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] The token cache is being invalidate because project f8dc41b46bc0402b9b900f59719afcf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:30.820339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:30.821002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:30.822570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 982/1981] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:30 2022] DELETE /identity/v3/projects/f8dc41b46bc0402b9b900f59719afcf3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:30.826450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:30.828401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:30.841248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7d1d8-a57a-47ec-89f1-414f473892d5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:30.846413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:30.847778 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:30.847778 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:30.847995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] PATH_INFO: `/v3/users/2615b999504748258ef5e4aada6e2d8f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:30.849210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2615b999504748258ef5e4aada6e2d8f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:30.851162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:30.988138 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23151d7bfc2c4ffcb0eb547e86358933'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:30.996394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23151d7bfc2c4ffcb0eb547e86358933'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.099996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23151d7bfc2c4ffcb0eb547e86358933'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.100635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23151d7bfc2c4ffcb0eb547e86358933'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.113821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c477632b-9237-4a44-8325-3b597b01d7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23151d7bfc2c4ffcb0eb547e86358933'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.126687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1000/1982] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:30 2022] DELETE /identity/v3/users/23151d7bfc2c4ffcb0eb547e86358933 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:31.130058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:31.130421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:31.130763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:31.148665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:31.149376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2615b999504748258ef5e4aada6e2d8f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.149995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:31.160589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2615b999504748258ef5e4aada6e2d8f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.166125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2615b999504748258ef5e4aada6e2d8f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.230396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1001/1983] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:31.244791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2615b999504748258ef5e4aada6e2d8f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.260769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:31.264699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:31.270880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2615b999504748258ef5e4aada6e2d8f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:31.292169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 983/1984] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:30 2022] DELETE /identity/v3/users/2615b999504748258ef5e4aada6e2d8f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:31.370058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e09a9-d910-4530-91a6-1f31c245b7d0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:31.437597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:31.438262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:31.438570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:31.438879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:31.502408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:31.503882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:31.513629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1002/1985] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:31.778540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:31.780605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:31.835482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36071703-0a24-4150-b355-6cdaf80537ed admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:31.839165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:31.839805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:31.840088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:31.840364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:31.842097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:31.906639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:31.909102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:31.912991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:31.920020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:31.929377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 984/1986] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:31.954629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb07aa-449e-43dd-9c0d-3c187465a985 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:31.970912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:31.971860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:31.972225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:31.972655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] PATH_INFO: `/v3/projects/3268fdfa91f74dea92c162a73a78b32c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:31.974452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3268fdfa91f74dea92c162a73a78b32c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:31.976281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.094313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3268fdfa91f74dea92c162a73a78b32c', 'request_id': 'req-b9cddd79-fd39-4c31-9247-e0a69275887e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.100104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3268fdfa91f74dea92c162a73a78b32c', 'request_id': 'req-b9cddd79-fd39-4c31-9247-e0a69275887e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.119131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.120588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:32.136081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6733a-5cda-4378-914a-5b8e551ee761 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.199152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.200039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.200323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.200597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] PATH_INFO: `/v3/projects/4f952daff0a54a4fb8fec55584bf191c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.202299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f952daff0a54a4fb8fec55584bf191c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.204283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.265749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3268fdfa91f74dea92c162a73a78b32c', 'request_id': 'req-b9cddd79-fd39-4c31-9247-e0a69275887e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.277240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] The token cache is being invalidate because project 3268fdfa91f74dea92c162a73a78b32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:32.277526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.278781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-b9cddd79-fd39-4c31-9247-e0a69275887e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.280353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1003/1987] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:31 2022] DELETE /identity/v3/projects/3268fdfa91f74dea92c162a73a78b32c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:32.285895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b799-ea4b-4038-901f-6f3cb27d04e2 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.286177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b799-ea4b-4038-901f-6f3cb27d04e2 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.286452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b799-ea4b-4038-901f-6f3cb27d04e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.304638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f217b799-ea4b-4038-901f-6f3cb27d04e2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:32.305831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f217b799-ea4b-4038-901f-6f3cb27d04e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:32.314092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1004/1988] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:32.321714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9537-1ad8-4fb5-8f2a-a3dcd839c7ed None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.322002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9537-1ad8-4fb5-8f2a-a3dcd839c7ed None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.322310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9537-1ad8-4fb5-8f2a-a3dcd839c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.346414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-92ea9537-1ad8-4fb5-8f2a-a3dcd839c7ed None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:32.347633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-92ea9537-1ad8-4fb5-8f2a-a3dcd839c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:32.355889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1005/1989] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:32.366846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9537-1ad8-4fb5-8f2a-a3dcd839c7ed None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.376201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9537-1ad8-4fb5-8f2a-a3dcd839c7ed None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.380949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.381600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.381881 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.382154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.382970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:32.383227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.384855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.397251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1006/1990] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:54:32.401503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.427136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780cb1b-57e5-43d8-be41-4d5e3921ece2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.432849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.433555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.433996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.434434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.435523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.437789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.465276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f952daff0a54a4fb8fec55584bf191c', 'request_id': 'req-afe3fba4-4b8f-41c8-879f-2dd99913113d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.471385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f952daff0a54a4fb8fec55584bf191c', 'request_id': 'req-afe3fba4-4b8f-41c8-879f-2dd99913113d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.572321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f952daff0a54a4fb8fec55584bf191c', 'request_id': 'req-afe3fba4-4b8f-41c8-879f-2dd99913113d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.588339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1007/1991] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:32.588339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.588951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] The token cache is being invalidate because project 4f952daff0a54a4fb8fec55584bf191c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:32.589464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.590210 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afe3fba4-4b8f-41c8-879f-2dd99913113d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:32.596143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 985/1992] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:32 2022] DELETE /identity/v3/projects/4f952daff0a54a4fb8fec55584bf191c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:32.597768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f78e-615e-4995-b2be-84a38cf5a58f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.598151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f78e-615e-4995-b2be-84a38cf5a58f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.598520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f78e-615e-4995-b2be-84a38cf5a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.618006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3e36f78e-615e-4995-b2be-84a38cf5a58f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:32.619359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3e36f78e-615e-4995-b2be-84a38cf5a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:32.654992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65362-23d4-4d27-9f4b-5ed76cae8805 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.659741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.660413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.660697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.660972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.661840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.663826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.688147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 986/1993] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:32.698118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411caa3f-65e3-4b2b-a7a4-b869ba47a806 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.698613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411caa3f-65e3-4b2b-a7a4-b869ba47a806 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.699207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411caa3f-65e3-4b2b-a7a4-b869ba47a806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.717787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-411caa3f-65e3-4b2b-a7a4-b869ba47a806 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:32.719010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-411caa3f-65e3-4b2b-a7a4-b869ba47a806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:32.727276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 987/1994] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:32.731658 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411caa3f-65e3-4b2b-a7a4-b869ba47a806 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.741172 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411caa3f-65e3-4b2b-a7a4-b869ba47a806 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.745913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.746554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.746875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.747404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.748132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:32.748480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.750125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.761450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 988/1996] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:32.762716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1008/1996] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:32.766974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.768968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.769176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:32.780918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdb021-33f5-4c3c-8b3a-948e2d6ff3c9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.781913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854699f4-3ea1-47db-9281-e65d99509d08 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.793736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.793736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.793736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.793736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.794081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.794081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.794242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.794242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.794242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.794242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.794815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.796665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.807740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 989/1997] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:32.811828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.822459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddbbc-737f-4b08-a2c9-20e7162571ba admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.830695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.831496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.833389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.833389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.833389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.834535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.844933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 990/1998] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:32.848925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.861425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2ef8-d58c-4a70-9361-9cb81c6e4319 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:32.866519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748e41-50d2-4863-99c9-12b10481e58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:32.867468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748e41-50d2-4863-99c9-12b10481e58c admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:32.867752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748e41-50d2-4863-99c9-12b10481e58c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:32.868029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748e41-50d2-4863-99c9-12b10481e58c admin admin] PATH_INFO: `/v3/projects/706f7f0afb0146ae8ff070db5fe5b407/users/4fa994043b9140ffbd48565495a92d22/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:32.883921 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748e41-50d2-4863-99c9-12b10481e58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=706f7f0afb0146ae8ff070db5fe5b407, user_id=4fa994043b9140ffbd48565495a92d22, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:32.886710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748e41-50d2-4863-99c9-12b10481e58c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:32.970575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1009/1999] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:32.974534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:32.993811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 991/2000] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:32 2022] PUT /identity/v3/projects/706f7f0afb0146ae8ff070db5fe5b407/users/4fa994043b9140ffbd48565495a92d22/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:33.008942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397728c-5289-44e4-a674-603d6ff74929 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.009318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397728c-5289-44e4-a674-603d6ff74929 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.009686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397728c-5289-44e4-a674-603d6ff74929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.046551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f397728c-5289-44e4-a674-603d6ff74929 None None] MFA Rules not processed for user `4fa994043b9140ffbd48565495a92d22`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:33.047907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f397728c-5289-44e4-a674-603d6ff74929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:33.063306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1694f-ca32-42a7-b7bd-630bdb14999e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.120255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 992/2001] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:33.125710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397728c-5289-44e4-a674-603d6ff74929 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.128596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.129499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.129967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.130424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.131372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.133645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.139803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397728c-5289-44e4-a674-603d6ff74929 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.148671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.148671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.148671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.148671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.149157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.150069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.275886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1010/2002] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:32 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:33.276957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.290171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 993/2003] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:33 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:33.290388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef410abf-ce16-410a-96ad-06c3da86a0da admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.291247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.357494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00081199-9969-46bb-91ca-9e03d376e2e1 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.363574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.364335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.364748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.364879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.365583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.367619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.372977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.374073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.374569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.374909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.376023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.377903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.388916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1011/2004] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:33.394986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.405421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552acaee-9427-456c-b30e-2ba0a7802f26 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.410195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.410919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.411204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.411482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.412217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.413890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.424174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1012/2005] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:33.435272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.444731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18450-a7db-4a2a-9a27-191dbfe99439 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.449459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88603-7c2f-4831-9c59-054e1483c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.450329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88603-7c2f-4831-9c59-054e1483c9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.450675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88603-7c2f-4831-9c59-054e1483c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.451003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88603-7c2f-4831-9c59-054e1483c9b1 admin admin] PATH_INFO: `/v3/projects/169acbd71766441bb7375eea99c7b71f/users/2d4187f5cb694f12bc2b1d259984b2c3/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.465711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88603-7c2f-4831-9c59-054e1483c9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169acbd71766441bb7375eea99c7b71f, user_id=2d4187f5cb694f12bc2b1d259984b2c3, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.468953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88603-7c2f-4831-9c59-054e1483c9b1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.487342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 994/2006] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:33 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:33.491033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.500694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61faf6-4803-40be-9d50-b87e20bae944 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.505394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.506025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.506308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.506609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.507405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.508979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.518942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 995/2007] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:33.522650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.537795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a2f0-e71c-45bd-bfd0-96099dd57078 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.538027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.538676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.538988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.539262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.539993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.541565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.552361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 996/2008] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:33.556222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.568576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7417c7-dd96-47dd-b8ee-5b9b7006b372 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.575078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aef4d-ed6c-4e3b-9f47-75017e1cb3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.576175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aef4d-ed6c-4e3b-9f47-75017e1cb3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.576559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aef4d-ed6c-4e3b-9f47-75017e1cb3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.577328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aef4d-ed6c-4e3b-9f47-75017e1cb3d7 admin admin] PATH_INFO: `/v3/projects/2012603461ee412f9331f0711b38193f/users/4b133851a5e14e40b2ca77e687ec1a24/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.595215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aef4d-ed6c-4e3b-9f47-75017e1cb3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2012603461ee412f9331f0711b38193f, user_id=4b133851a5e14e40b2ca77e687ec1a24, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.598382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aef4d-ed6c-4e3b-9f47-75017e1cb3d7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.649094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1013/2009] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:33 2022] PUT /identity/v3/projects/169acbd71766441bb7375eea99c7b71f/users/2d4187f5cb694f12bc2b1d259984b2c3/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:33.664814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecef3b-0c4d-4f49-a464-c2ae9c83563d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.665100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecef3b-0c4d-4f49-a464-c2ae9c83563d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.665373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecef3b-0c4d-4f49-a464-c2ae9c83563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.697723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-bfecef3b-0c4d-4f49-a464-c2ae9c83563d None None] MFA Rules not processed for user `2d4187f5cb694f12bc2b1d259984b2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:33.698975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-bfecef3b-0c4d-4f49-a464-c2ae9c83563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:33.712008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 997/2010] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:33 2022] PUT /identity/v3/projects/2012603461ee412f9331f0711b38193f/users/4b133851a5e14e40b2ca77e687ec1a24/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:33.723136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93585-d5f0-4382-b8c9-bd65acec8c29 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.723506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93585-d5f0-4382-b8c9-bd65acec8c29 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.723842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93585-d5f0-4382-b8c9-bd65acec8c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.751912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dea93585-d5f0-4382-b8c9-bd65acec8c29 None None] MFA Rules not processed for user `4b133851a5e14e40b2ca77e687ec1a24`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:33.753221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dea93585-d5f0-4382-b8c9-bd65acec8c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:33.776365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1014/2011] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:33.780919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecef3b-0c4d-4f49-a464-c2ae9c83563d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.831073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 998/2012] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:33.835173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea93585-d5f0-4382-b8c9-bd65acec8c29 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:33.846751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecef3b-0c4d-4f49-a464-c2ae9c83563d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.908304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea93585-d5f0-4382-b8c9-bd65acec8c29 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:33.914027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.915893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.916327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.916707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.918124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.923856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:33.931381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:33.932282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:33.932790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:33.933312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:33.934182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:33.939105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.080395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 999/2013] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:33 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:34.084516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.088722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1015/2014] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:33 2022] POST /identity/v3/projects => generated 373 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:34.089737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.157847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020183b0-1b70-44fa-88de-58e27909b43e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.163253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239a57-d0c2-4882-9f77-5885b7020ad8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.165124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.165809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.166093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.166366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.167243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.169161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.173320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.174005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.174290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.174570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.175317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.178103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.328527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1000/2015] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:34 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:34.328733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1016/2016] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:34 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:34.328869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.329930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.338929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68421aaf-eb0c-42d1-a855-06d566f6c894 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.339792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1c6d-38fe-492b-b032-ee4db36275a8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.343663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.344332 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.344534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.344669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.344877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.345186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.345466 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.345647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.345752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.346461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.347284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.348101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.357439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1001/2017] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:34.361049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1017/2018] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:34.361290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.362027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.372740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bd398-2332-4b70-9bb8-eea55d3e5f0c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.378776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.379864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.380296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.380766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] PATH_INFO: `/v3/projects/68cc3b9c5f844159a064519d5aeb54ec/users/fa77389cc39f49378f936bd328a3d161/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.391364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9e1f-2290-4df4-8338-d92b0fdc4c86 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.396527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.397423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.397659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cc3b9c5f844159a064519d5aeb54ec, user_id=fa77389cc39f49378f936bd328a3d161, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.397790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.406105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] PATH_INFO: `/v3/projects/74ae07b973714c57bbd4910b7d7ed834/users/06d4f259285b466a893eeff1536c1263/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.406232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.414180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ae07b973714c57bbd4910b7d7ed834, user_id=06d4f259285b466a893eeff1536c1263, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.416877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.546347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1002/2019] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:34 2022] PUT /identity/v3/projects/68cc3b9c5f844159a064519d5aeb54ec/users/fa77389cc39f49378f936bd328a3d161/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:34.548242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1018/2020] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:34 2022] PUT /identity/v3/projects/74ae07b973714c57bbd4910b7d7ed834/users/06d4f259285b466a893eeff1536c1263/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:34.552167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.552741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.612639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fb972-6b6c-4e22-84fc-4e640b96e9c0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.618190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372975cf-64c8-44fd-9b9c-c346a2230224 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.623239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.624868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.625209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.625492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.626321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.627378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.628142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.628219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.628533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.628800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.629548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.631284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.638911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1019/2021] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:34.642575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1003/2022] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:34.643082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.646553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.654181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e8680-db2a-4359-a0b3-05fecb4ab15c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.656684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e58a0-8ec9-474c-89be-4a9b6b181ec5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.659403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e593244-35ee-434a-ac27-36fbae23d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.660390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e593244-35ee-434a-ac27-36fbae23d79a admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.660745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e593244-35ee-434a-ac27-36fbae23d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.661093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e593244-35ee-434a-ac27-36fbae23d79a admin admin] PATH_INFO: `/v3/projects/68cc3b9c5f844159a064519d5aeb54ec/users/fa77389cc39f49378f936bd328a3d161/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.662615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce88b6e-0224-4053-9c34-be618702f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.663355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e593244-35ee-434a-ac27-36fbae23d79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cc3b9c5f844159a064519d5aeb54ec, user_id=fa77389cc39f49378f936bd328a3d161, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.663656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce88b6e-0224-4053-9c34-be618702f030 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.665870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce88b6e-0224-4053-9c34-be618702f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.666158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce88b6e-0224-4053-9c34-be618702f030 admin admin] PATH_INFO: `/v3/projects/74ae07b973714c57bbd4910b7d7ed834/users/06d4f259285b466a893eeff1536c1263/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.666580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e593244-35ee-434a-ac27-36fbae23d79a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.668251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce88b6e-0224-4053-9c34-be618702f030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ae07b973714c57bbd4910b7d7ed834, user_id=06d4f259285b466a893eeff1536c1263, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.671562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce88b6e-0224-4053-9c34-be618702f030 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.679009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1020/2023] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:34 2022] PUT /identity/v3/projects/68cc3b9c5f844159a064519d5aeb54ec/users/fa77389cc39f49378f936bd328a3d161/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:34.682905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1004/2024] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:34 2022] PUT /identity/v3/projects/74ae07b973714c57bbd4910b7d7ed834/users/06d4f259285b466a893eeff1536c1263/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:34.695011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812222-1012-401d-86bb-9a7899e19634 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.695186 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.695421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.695533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812222-1012-401d-86bb-9a7899e19634 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.695701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.695866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812222-1012-401d-86bb-9a7899e19634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.723482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] MFA Rules not processed for user `06d4f259285b466a893eeff1536c1263`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:34.724604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-48812222-1012-401d-86bb-9a7899e19634 None None] MFA Rules not processed for user `fa77389cc39f49378f936bd328a3d161`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:34.724730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:34.731289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-48812222-1012-401d-86bb-9a7899e19634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:34.793958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1005/2025] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:34.803774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1021/2026] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:34.804460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.805899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:34.813672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48812222-1012-401d-86bb-9a7899e19634 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:34.815008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-48812222-1012-401d-86bb-9a7899e19634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:34.861642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b541a-a1c4-495f-afd5-f1ea39881af3 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.865360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.865998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.866272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.866540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.868645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48812222-1012-401d-86bb-9a7899e19634 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:34.872513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:34.873150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:34.873932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:34.874205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:34.919980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.921963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.929634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:34.931269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1006/2027] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:34.931391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:34.941178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1022/2028] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:38.470169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:38.478425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bd6d8-fe7a-4072-831a-84b87a16621d service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:38.482149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:38.482908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:38.483196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:38.483474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:38.544825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:38.546420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:38.555986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1007/2029] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:39.673622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:39.742547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:39.743887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:39.754498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f64f-cb5c-41b0-918d-9003c7d4dd0b service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:39.758279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c38d1-29e6-4887-a739-19a99377b237 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:39.760566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:39.760566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:39.760566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:39.760566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] PATH_INFO: `/v3/users/2d4187f5cb694f12bc2b1d259984b2c3` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:39.761605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4187f5cb694f12bc2b1d259984b2c3)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:39.762998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:39.763560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:39.764376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:39.764658 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:39.764930 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] PATH_INFO: `/v3/users/489b6a782236474a927b20fe383e9162` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:39.766131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=489b6a782236474a927b20fe383e9162)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:39.768094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:40.209098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489b6a782236474a927b20fe383e9162'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.210226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4187f5cb694f12bc2b1d259984b2c3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.216175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489b6a782236474a927b20fe383e9162'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.216887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489b6a782236474a927b20fe383e9162'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.217304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4187f5cb694f12bc2b1d259984b2c3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.362599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489b6a782236474a927b20fe383e9162'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.376479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-65e9c1de-621d-4825-b0ab-271d770fd609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489b6a782236474a927b20fe383e9162'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.382771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1008/2030] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:39 2022] DELETE /identity/v3/users/489b6a782236474a927b20fe383e9162 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:40.499868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4187f5cb694f12bc2b1d259984b2c3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.500538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4187f5cb694f12bc2b1d259984b2c3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.515641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4187f5cb694f12bc2b1d259984b2c3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:40.522457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1023/2031] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:39 2022] DELETE /identity/v3/users/2d4187f5cb694f12bc2b1d259984b2c3 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:40.527230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:40.527602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:40.528044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:40.547465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:40.548788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:40.605475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1009/2032] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:40.627260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:40.630192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:40.753738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e2724-3f6e-413d-95b2-3ab3f38acfaa admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:40.753738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf70a0-4a9b-4af8-b0d5-45addc785207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:40.753738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf70a0-4a9b-4af8-b0d5-45addc785207 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:40.753738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf70a0-4a9b-4af8-b0d5-45addc785207 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:40.776318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf70a0-4a9b-4af8-b0d5-45addc785207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:40.776318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf70a0-4a9b-4af8-b0d5-45addc785207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:40.776318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf70a0-4a9b-4af8-b0d5-45addc785207 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:40.776318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1024/2033] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:40.838304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:40.838304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:40.845955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2c4fa-754c-4b94-a960-1d0e3321e8c2 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:40.851744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:40.852722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:40.853128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:40.853491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] PATH_INFO: `/v3/projects/51320950439a476392f62fc3620f9a82` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:40.854966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51320950439a476392f62fc3620f9a82)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:40.857092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:41.129679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51320950439a476392f62fc3620f9a82', 'request_id': 'req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.136132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51320950439a476392f62fc3620f9a82', 'request_id': 'req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.301792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51320950439a476392f62fc3620f9a82', 'request_id': 'req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.308690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] The token cache is being invalidate because project 51320950439a476392f62fc3620f9a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:41.309083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.309724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.311945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1010/2034] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:40 2022] DELETE /identity/v3/projects/51320950439a476392f62fc3620f9a82 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:41.317607 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463c99-e77c-46c5-b931-b35a86fb0caa None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.318101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463c99-e77c-46c5-b931-b35a86fb0caa None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.318379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463c99-e77c-46c5-b931-b35a86fb0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.341371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-65463c99-e77c-46c5-b931-b35a86fb0caa None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:41.342656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-65463c99-e77c-46c5-b931-b35a86fb0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:41.367976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:41.369451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:41.412233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1025/2035] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:41.421023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.421310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.421584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.428840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411671e-25f4-44aa-a9f9-0ebc6b8ab5f6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:41.432482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:41.433123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.433399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.433670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.440355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:41.441625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:41.444113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:41.450208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1026/2036] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:41.452183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:41.460567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:41.466670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7822-6ea8-4d78-93e9-751febdf57ee None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:41.472487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:41.473560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.473839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.474110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] PATH_INFO: `/v3/projects/169acbd71766441bb7375eea99c7b71f` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.475520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169acbd71766441bb7375eea99c7b71f)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:41.477978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:41.516953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:41.518398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:41.528195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1011/2037] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:41.528831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:41.539365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027851ea-ed60-4dd1-aa0a-38f0c14053ff service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:41.544249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:41.545499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.545777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.546234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.547004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:41.551220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:41.551220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:41.560851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1012/2038] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:41.566146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:41.576971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fddb79-78d5-4a90-a004-0cd69fad80e4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:41.581858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:41.585671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.585671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.585671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.585671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:41.585671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:41.625844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169acbd71766441bb7375eea99c7b71f', 'request_id': 'req-4122b34d-1148-412f-afc9-ad4efde74976'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.631454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169acbd71766441bb7375eea99c7b71f', 'request_id': 'req-4122b34d-1148-412f-afc9-ad4efde74976'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.728590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169acbd71766441bb7375eea99c7b71f', 'request_id': 'req-4122b34d-1148-412f-afc9-ad4efde74976'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.737741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1013/2039] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:41 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:41.745118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:41.745876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] The token cache is being invalidate because project 169acbd71766441bb7375eea99c7b71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:41.745876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.745876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:41.745876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1027/2040] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:41 2022] DELETE /identity/v3/projects/169acbd71766441bb7375eea99c7b71f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:41.749174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:41.751103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:41.811573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc897bd5-72d1-46ea-993a-bf2bc81524e9 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:41.816633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:41.817378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.817727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.818191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.818935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:41.820950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:41.837670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122b34d-1148-412f-afc9-ad4efde74976 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:41.843209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:41.844145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:41.844430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:41.844700 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] PATH_INFO: `/v3/users/fa77389cc39f49378f936bd328a3d161` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:41.845934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa77389cc39f49378f936bd328a3d161)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:41.847885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:42.086859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1014/2041] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:41 2022] POST /identity/v3/users => generated 287 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:42.087841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:42.089419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:42.101891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d9aa-b06d-4027-afae-f3569ebd7b01 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:42.106553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:42.107428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.107709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.107992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] PATH_INFO: `/v3/users/1f3aca7cd838490fa8a52d42a540fb60` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.109254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3aca7cd838490fa8a52d42a540fb60)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:42.111189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:42.284369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa77389cc39f49378f936bd328a3d161'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.291195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa77389cc39f49378f936bd328a3d161'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.353607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3aca7cd838490fa8a52d42a540fb60'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.360702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3aca7cd838490fa8a52d42a540fb60'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.361387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3aca7cd838490fa8a52d42a540fb60'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.370159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa77389cc39f49378f936bd328a3d161'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.371341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa77389cc39f49378f936bd328a3d161'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.384965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4d55bcd8-30fd-4517-a1b2-e386b6e0a192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa77389cc39f49378f936bd328a3d161'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.391637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1028/2042] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:41 2022] DELETE /identity/v3/users/fa77389cc39f49378f936bd328a3d161 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:42.393053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.393343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.393620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.411481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] MFA Rules not processed for user `f12d89fe1feb44c094e1321c41deac60`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:42.412723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:42.483251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3aca7cd838490fa8a52d42a540fb60'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.486434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1029/2043] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:42.487207 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:42.488673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:42.498661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f0ffb189-4181-4c43-8eff-5f766b1b0eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3aca7cd838490fa8a52d42a540fb60'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:42.509022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1015/2044] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:42 2022] DELETE /identity/v3/users/1f3aca7cd838490fa8a52d42a540fb60 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:42.510504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.510830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.511107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.535392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:42.536789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:42.575576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e1eef-92a0-4152-893c-a029ca1b84cd None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:42.607082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1016/2045] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:42.617975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:42.619445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:42.644489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:42.645492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.645826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.646061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.646846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:42.648940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:42.663055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1030/2046] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:42.664252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:42.675716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e2d5f-e2aa-4579-ac4e-6e95f46f98aa admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:42.680745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:42.681495 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.681786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.682091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.682848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:42.683374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c66a8-2392-4a59-829b-5be8769ae0a3 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:42.684498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:42.688920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567730f-e0f0-419b-9028-544b3cc65d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:42.695820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567730f-e0f0-419b-9028-544b3cc65d4a service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.695820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567730f-e0f0-419b-9028-544b3cc65d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.695820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567730f-e0f0-419b-9028-544b3cc65d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.698638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1031/2047] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:42.702719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:42.708206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567730f-e0f0-419b-9028-544b3cc65d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:42.711521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567730f-e0f0-419b-9028-544b3cc65d4a service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:42.714512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c629c-c2dc-45cf-9cac-b011efe42ed2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:42.719889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:42.721160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.721384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.721766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] PATH_INFO: `/v3/projects/e0c593de1c1e433b86eea90784cfd224/users/60b9844d6ecd4915ae25ce8014fbd2a7/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.730457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1017/2048] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:42.740755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c593de1c1e433b86eea90784cfd224, user_id=60b9844d6ecd4915ae25ce8014fbd2a7, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:42.744001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:42.891107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1032/2049] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:42 2022] PUT /identity/v3/projects/e0c593de1c1e433b86eea90784cfd224/users/60b9844d6ecd4915ae25ce8014fbd2a7/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:42.901217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:42.901507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:42.901819 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:42.931701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] MFA Rules not processed for user `60b9844d6ecd4915ae25ce8014fbd2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:42.933487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:43.025010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1018/2050] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:43.025106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:43.132407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516404e-1504-4ca3-bacc-a5e3e7c03562 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:43.139305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:43.160389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.160389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.160389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.160389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:43.160389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:43.222368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:43.227679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:43.251607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd809d-0d6a-4aca-bf5c-e685724b063f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:43.260379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:43.261222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.261503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.264524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] PATH_INFO: `/v3/projects/68cc3b9c5f844159a064519d5aeb54ec` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.264524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68cc3b9c5f844159a064519d5aeb54ec)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:43.265126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:43.342140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1033/2051] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:43 2022] POST /identity/v3/projects => generated 373 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:43.346275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:43.409717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ed3a0-e4e4-45cb-a09f-37218f46417f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:43.414757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:43.415489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.415777 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.416058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.416767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:43.418781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:43.433162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68cc3b9c5f844159a064519d5aeb54ec', 'request_id': 'req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:43.439039 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68cc3b9c5f844159a064519d5aeb54ec', 'request_id': 'req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:43.558271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1034/2052] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:43 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:43.558996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:43.563524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68cc3b9c5f844159a064519d5aeb54ec', 'request_id': 'req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:43.567292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:43.582587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] The token cache is being invalidate because project 68cc3b9c5f844159a064519d5aeb54ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:43.583169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:43.583873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:43.587938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1019/2053] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:43 2022] DELETE /identity/v3/projects/68cc3b9c5f844159a064519d5aeb54ec => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:43.588666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338194d-7550-43e0-af17-dac7c3e379c1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:43.588781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:43.590082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:43.663368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3c3e-0ddf-4bce-bab8-3ed1fdaa1d10 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:43.669566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456565f7-a7a0-4586-9b9d-e4918492090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:43.671062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456565f7-a7a0-4586-9b9d-e4918492090f admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.671535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456565f7-a7a0-4586-9b9d-e4918492090f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.671903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456565f7-a7a0-4586-9b9d-e4918492090f admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.672754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456565f7-a7a0-4586-9b9d-e4918492090f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:43.674399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456565f7-a7a0-4586-9b9d-e4918492090f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:43.679925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:43.681274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.681652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.681894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] PATH_INFO: `/v3/projects/58f9746367c342c4a916154a48ce4d59` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.683049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f9746367c342c4a916154a48ce4d59)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:43.686917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1020/2054] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:43.687046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:43.687151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4e8f-887b-492f-a148-f44dded4603b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.687151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4e8f-887b-492f-a148-f44dded4603b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.687151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df4e8f-887b-492f-a148-f44dded4603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.706306 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-13df4e8f-887b-492f-a148-f44dded4603b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:43.707633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-13df4e8f-887b-492f-a148-f44dded4603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:43.715924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1021/2055] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:43.716715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df4e8f-887b-492f-a148-f44dded4603b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:43.727733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df4e8f-887b-492f-a148-f44dded4603b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:43.730882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a82536-e7c7-4705-bcad-0555a9cd1fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:43.731792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a82536-e7c7-4705-bcad-0555a9cd1fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.732125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a82536-e7c7-4705-bcad-0555a9cd1fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.732951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a82536-e7c7-4705-bcad-0555a9cd1fc4 admin admin] PATH_INFO: `/v3/projects/e50d20422f544cb486304ab3e8064830/users/3cd2d60ef5784e46a8eafb212bc90abb/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.747275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a82536-e7c7-4705-bcad-0555a9cd1fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50d20422f544cb486304ab3e8064830, user_id=3cd2d60ef5784e46a8eafb212bc90abb, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:43.750521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a82536-e7c7-4705-bcad-0555a9cd1fc4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:43.905196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1022/2056] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:43 2022] PUT /identity/v3/projects/e50d20422f544cb486304ab3e8064830/users/3cd2d60ef5784e46a8eafb212bc90abb/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:43.906501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d0df4-735f-4bf5-bcb8-277ef2d9bb72 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:43.906815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d0df4-735f-4bf5-bcb8-277ef2d9bb72 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:43.907094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d0df4-735f-4bf5-bcb8-277ef2d9bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:43.915740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f9746367c342c4a916154a48ce4d59', 'request_id': 'req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:43.922971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f9746367c342c4a916154a48ce4d59', 'request_id': 'req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:43.925578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-124d0df4-735f-4bf5-bcb8-277ef2d9bb72 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:43.926548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-124d0df4-735f-4bf5-bcb8-277ef2d9bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:43.984515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1023/2057] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:43.988394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d0df4-735f-4bf5-bcb8-277ef2d9bb72 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:43.998739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d0df4-735f-4bf5-bcb8-277ef2d9bb72 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.003971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.004676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.004964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.005245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.005991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.007642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.018445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1024/2058] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:44.019510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.034415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbbe9-fdd9-4cf4-80b2-ba09b3d60f7d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.035550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.036203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.036489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.036771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.037512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:44.037833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.039511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.051920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1025/2059] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:44.052686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.062668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95342d-de32-42a4-8d72-c0fffa864733 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.067358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.068268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.068544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.068842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] PATH_INFO: `/v3/projects/e50d20422f544cb486304ab3e8064830/users/3cd2d60ef5784e46a8eafb212bc90abb/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.069917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f9746367c342c4a916154a48ce4d59', 'request_id': 'req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.071149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50d20422f544cb486304ab3e8064830, user_id=3cd2d60ef5784e46a8eafb212bc90abb, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.073831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.085883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1026/2060] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:44 2022] PUT /identity/v3/projects/e50d20422f544cb486304ab3e8064830/users/3cd2d60ef5784e46a8eafb212bc90abb/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:44.085883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.089998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] The token cache is being invalidate because project 58f9746367c342c4a916154a48ce4d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:44.090287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.090966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d1d8813b-1b84-4a27-9424-ea5288f7b3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.094018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1035/2061] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:43 2022] DELETE /identity/v3/projects/58f9746367c342c4a916154a48ce4d59 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:44.095307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.095594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.095871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.130362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] MFA Rules not processed for user `3cd2d60ef5784e46a8eafb212bc90abb`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:44.132568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:44.170534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bdc2-08a9-4e83-a105-50bb78ddf76c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.177858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.178534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.178852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.179305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.180053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.182158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.221914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1036/2062] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:44.222779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.224148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:44.243148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d0592-8d1c-4801-ae5c-51897a3a60f0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.243148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.243148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.244093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.244382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] PATH_INFO: `/v3/users/924ce2cbe70b4ebcb577685ddac2be23` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.245960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924ce2cbe70b4ebcb577685ddac2be23)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.248333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.340724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1027/2063] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:44 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:44.346181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.346181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:44.401804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb22a2-8c2f-4a93-8add-ca7c5ba941ed admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.406069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.406705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.407020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.407295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.466112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.468194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.477487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1028/2064] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:44.478288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.479558 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:44.544515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880145b-d7fb-45ff-8ece-c2c04c5dee96 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.549312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.551385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.551385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.551385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.551385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.553136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.600053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924ce2cbe70b4ebcb577685ddac2be23'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.604697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924ce2cbe70b4ebcb577685ddac2be23'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.687728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1029/2065] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:44 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:44.691324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.701502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0f90-f29f-40c2-80dd-2e5608617826 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.706452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.707135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.707419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.707693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.708463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.710036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.714976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924ce2cbe70b4ebcb577685ddac2be23'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.715641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924ce2cbe70b4ebcb577685ddac2be23'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.720545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1030/2066] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:44.724491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.726266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:44.730366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924ce2cbe70b4ebcb577685ddac2be23'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:44.737017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1037/2067] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:44 2022] DELETE /identity/v3/users/924ce2cbe70b4ebcb577685ddac2be23 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:44.739697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc81f-8358-48db-9142-5876ec664b19 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.794723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.795579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.795867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.796148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.796925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.798564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.809359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1031/2068] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:44.818200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.824200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:44.825602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafecb93-0e05-4d8f-a29a-3f7733e38fe8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.826715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:44.831333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.832432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.832726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.833105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] PATH_INFO: `/v3/projects/7ad7fc2c600d4ead8797b23617aef25b/users/b3175ddde1c545dabb8d588f2f3eba0b/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.848031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad7fc2c600d4ead8797b23617aef25b, user_id=b3175ddde1c545dabb8d588f2f3eba0b, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.850793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.882374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd1b0-8460-41d5-a0a4-0b771e7a9809 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:44.886143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073af4ce-2d7d-40db-a964-25dc1a16334e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:44.886820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af4ce-2d7d-40db-a964-25dc1a16334e service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:44.887108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af4ce-2d7d-40db-a964-25dc1a16334e service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:44.887392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073af4ce-2d7d-40db-a964-25dc1a16334e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:44.889841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-073af4ce-2d7d-40db-a964-25dc1a16334e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:44.947790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073af4ce-2d7d-40db-a964-25dc1a16334e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:44.949231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073af4ce-2d7d-40db-a964-25dc1a16334e service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:44.958589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1032/2069] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:45.167747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1038/2070] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:44 2022] PUT /identity/v3/projects/7ad7fc2c600d4ead8797b23617aef25b/users/b3175ddde1c545dabb8d588f2f3eba0b/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:45.178664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.179164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.179450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.209055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] MFA Rules not processed for user `b3175ddde1c545dabb8d588f2f3eba0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:45.210361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:45.273829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1033/2071] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:45.278389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.339046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e52c16-e61d-4d54-97fe-e1f43903d628 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.343760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.344414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.344692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.344961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.345666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.347586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:45.414118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.416527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:45.430031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cdc57-9559-400b-96b2-4eccabe187c1 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.434575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.436072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.436360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.436637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] PATH_INFO: `/v3/projects/40be84fe178a4be18eb31ac6b87e585d` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.437857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40be84fe178a4be18eb31ac6b87e585d)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.440062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:45.449121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1039/2072] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:45 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:45.454149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.512764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36e32-c7b0-4b24-82e3-509aba15c63b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.517929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.518578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.518888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.519160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.519880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.521799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:45.641304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40be84fe178a4be18eb31ac6b87e585d', 'request_id': 'req-71a12096-a516-4e98-b9ff-14341484b498'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:45.648193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40be84fe178a4be18eb31ac6b87e585d', 'request_id': 'req-71a12096-a516-4e98-b9ff-14341484b498'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:45.670890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1040/2073] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:45 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:45.672341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.684066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe6b6-821d-4696-8358-73ab64e47667 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.750205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.751014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.751321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.751575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.752319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.753923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:45.764555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1041/2074] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:45.769022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.778860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bede81-b56d-4d46-84aa-8ccf37802fb5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.784322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.785136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.785277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.785533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.786273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.787893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:45.798004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1042/2075] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:45.802018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.807789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40be84fe178a4be18eb31ac6b87e585d', 'request_id': 'req-71a12096-a516-4e98-b9ff-14341484b498'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:45.811661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018c544-5d62-4819-89ea-83e0967c94df admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.816502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1990-acb2-45c0-8e8d-69d4cf0fff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.817365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1990-acb2-45c0-8e8d-69d4cf0fff9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.817649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1990-acb2-45c0-8e8d-69d4cf0fff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.817917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1990-acb2-45c0-8e8d-69d4cf0fff9c admin admin] PATH_INFO: `/v3/projects/0bcbc975f01e49f8bc403791fa212071/users/b5a0c47186f445ba8a17d7c8251eb037/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.819791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] The token cache is being invalidate because project 40be84fe178a4be18eb31ac6b87e585d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:45.820076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:45.820812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-71a12096-a516-4e98-b9ff-14341484b498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:45.822653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1034/2076] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:45 2022] DELETE /identity/v3/projects/40be84fe178a4be18eb31ac6b87e585d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:45.830107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbabdff-0383-4bec-a035-be0c6b68cae6 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.830368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbabdff-0383-4bec-a035-be0c6b68cae6 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.830673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbabdff-0383-4bec-a035-be0c6b68cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.833303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b1990-acb2-45c0-8e8d-69d4cf0fff9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcbc975f01e49f8bc403791fa212071, user_id=b5a0c47186f445ba8a17d7c8251eb037, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.835995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b1990-acb2-45c0-8e8d-69d4cf0fff9c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:45.848365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3bbabdff-0383-4bec-a035-be0c6b68cae6 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:45.849568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3bbabdff-0383-4bec-a035-be0c6b68cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:45.858583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1035/2077] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:45.865536 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e92ed7-50d0-4712-a9e9-de2e9a9a7130 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.865821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e92ed7-50d0-4712-a9e9-de2e9a9a7130 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.866077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e92ed7-50d0-4712-a9e9-de2e9a9a7130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.883823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e3e92ed7-50d0-4712-a9e9-de2e9a9a7130 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:45.884964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e3e92ed7-50d0-4712-a9e9-de2e9a9a7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:45.892574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1036/2078] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:45.901357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e92ed7-50d0-4712-a9e9-de2e9a9a7130 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.909812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e92ed7-50d0-4712-a9e9-de2e9a9a7130 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.914319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.914947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.915224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.915494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.916204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:45.916505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.918081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:45.929858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1037/2079] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:54:45.941959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:45.951943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b346ac-74c7-4879-aee9-d08ff1ac7bea admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:45.956637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:45.966455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:45.966455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:45.966455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:45.966455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:45.966455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.003396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1043/2080] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:45 2022] PUT /identity/v3/projects/0bcbc975f01e49f8bc403791fa212071/users/b5a0c47186f445ba8a17d7c8251eb037/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:46.013872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.014188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.014442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.039919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] MFA Rules not processed for user `b5a0c47186f445ba8a17d7c8251eb037`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:46.041118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:46.102321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1044/2081] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:54:46.106773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.108580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:46.172634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f209a7f-9ddf-42ce-95cf-83b01d701f29 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.177193 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.177840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.178118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.178480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.179107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.181045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.196592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1038/2082] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:45 2022] POST /identity/v3/projects => generated 371 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:46.200673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.260378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa541b-1461-41b3-8388-ed989bd7e662 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.265147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.265808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.266127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.266363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.267105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.269087 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.317467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1045/2083] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:46 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:46.321326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.392096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078a4d-6d3f-40ad-b8a7-bc7a3d128e15 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.396985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.397651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.397933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.398208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.398945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.400844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.479170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1039/2084] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:46 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:46.483725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.493134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48ac3c-a9c6-42eb-b5f4-dc895f555349 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.498614 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.499284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.499570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.499850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.500581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.502158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.511675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1040/2085] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:46.523018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.532638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35bfcc-9538-442a-8c1a-f9b41d9a8ceb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.537064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.537669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.537990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.538261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.539011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.540527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.550500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1041/2086] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:46.553775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1046/2087] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:46 2022] POST /identity/v3/users => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:54:46.556481 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.556630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.566392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1605b1-6f6d-4d0e-898c-5c309cc68b55 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.566664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7af33-c5dd-46d2-90bc-b27a40f7a606 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.571279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0240968-87bb-489e-9616-97822432d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.571428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.572094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.572206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0240968-87bb-489e-9616-97822432d810 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.572379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.572502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0240968-87bb-489e-9616-97822432d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.572649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.572774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0240968-87bb-489e-9616-97822432d810 admin admin] PATH_INFO: `/v3/projects/45cef721011d4bc385f3fed06e492c22/users/4206483570704442b478d91317d1b491/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.573375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.574970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.585704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1042/2088] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:46.588398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0240968-87bb-489e-9616-97822432d810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cef721011d4bc385f3fed06e492c22, user_id=4206483570704442b478d91317d1b491, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.591131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0240968-87bb-489e-9616-97822432d810 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.598108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.607899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209bdd6-9ad4-4b6a-8885-35e45dabeeb8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.612612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.613461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.613738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.614005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] PATH_INFO: `/v3/projects/51f6581c62e74cd98f9bd81e08ba4be4/users/dc925f6f3e0544eeb088e3e71b393714/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.628176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f6581c62e74cd98f9bd81e08ba4be4, user_id=dc925f6f3e0544eeb088e3e71b393714, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.630774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.736259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1047/2089] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:46 2022] PUT /identity/v3/projects/45cef721011d4bc385f3fed06e492c22/users/4206483570704442b478d91317d1b491/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:46.747126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.747418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.747693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.784392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:46.784392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:46.819119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1043/2090] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:46 2022] PUT /identity/v3/projects/51f6581c62e74cd98f9bd81e08ba4be4/users/dc925f6f3e0544eeb088e3e71b393714/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:46.823911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.904226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1048/2091] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:46.931741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be32bd-d618-4fef-9a72-0aa075f0c1a0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.939727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.940489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.941014 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.941493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.942429 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.949226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:46.958203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.959573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:46.965127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1044/2092] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:54:46.969251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:46.985474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081be01-a773-4552-822b-9c0b99597f3a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:46.990605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6e07-a0b9-42d2-9e22-017e961ae52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:46.991794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6e07-a0b9-42d2-9e22-017e961ae52c admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:46.992274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6e07-a0b9-42d2-9e22-017e961ae52c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:46.992759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6e07-a0b9-42d2-9e22-017e961ae52c admin admin] PATH_INFO: `/v3/projects/51f6581c62e74cd98f9bd81e08ba4be4/users/dc925f6f3e0544eeb088e3e71b393714/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:46.994926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6e07-a0b9-42d2-9e22-017e961ae52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f6581c62e74cd98f9bd81e08ba4be4, user_id=dc925f6f3e0544eeb088e3e71b393714, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:46.998428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6e07-a0b9-42d2-9e22-017e961ae52c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:47.012707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1045/2093] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:46 2022] PUT /identity/v3/projects/51f6581c62e74cd98f9bd81e08ba4be4/users/dc925f6f3e0544eeb088e3e71b393714/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:47.026790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:47.027777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:47.028164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:47.040893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5324d-db2b-4a9f-b1c9-b8ea5b569913 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:47.055834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] MFA Rules not processed for user `dc925f6f3e0544eeb088e3e71b393714`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:47.057139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:47.092067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:47.092708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:47.092988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:47.093257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:47.134531 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1046/2094] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:47.164923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:47.166307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:47.176944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1049/2095] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:47.230478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:47.232250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:47.293653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9931-f9d5-4b83-a553-dff39e06f758 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:47.297482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954b5df-d214-4dd5-bb0c-15bf403654bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:47.304329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954b5df-d214-4dd5-bb0c-15bf403654bf service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:47.304329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954b5df-d214-4dd5-bb0c-15bf403654bf service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:47.304329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954b5df-d214-4dd5-bb0c-15bf403654bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:47.304329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1954b5df-d214-4dd5-bb0c-15bf403654bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:47.360494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954b5df-d214-4dd5-bb0c-15bf403654bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:47.362130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954b5df-d214-4dd5-bb0c-15bf403654bf service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:47.373889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1047/2096] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:48.135073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:48.140645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:48.159749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566579e7-58ba-47a5-89d2-ddfd15fcc7c2 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:48.167904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:48.175080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:48.175080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:48.175080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] PATH_INFO: `/v3/users/4fa994043b9140ffbd48565495a92d22` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:48.181658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa994043b9140ffbd48565495a92d22)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:48.183632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:48.463100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa994043b9140ffbd48565495a92d22'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:48.470296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa994043b9140ffbd48565495a92d22'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:48.556693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa994043b9140ffbd48565495a92d22'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:48.557469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa994043b9140ffbd48565495a92d22'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:48.582561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa994043b9140ffbd48565495a92d22'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:48.589498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1050/2097] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:48 2022] DELETE /identity/v3/users/4fa994043b9140ffbd48565495a92d22 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:48.594961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:48.595479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:48.595559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:48.614137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:48.615542 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:48.684942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1048/2098] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:48.697233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:48.698908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:48.763335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f515a-5cb3-4c06-ad3a-b7cbf35e9e85 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:48.767265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d478749-2980-49a3-8035-b6fd525b9078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:48.767944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d478749-2980-49a3-8035-b6fd525b9078 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:48.768247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d478749-2980-49a3-8035-b6fd525b9078 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:48.768520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d478749-2980-49a3-8035-b6fd525b9078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:48.777759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d478749-2980-49a3-8035-b6fd525b9078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:48.781828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d478749-2980-49a3-8035-b6fd525b9078 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:48.789047 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1051/2099] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:49.696436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:49.698402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:49.711727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8c0fa-1597-42f6-97b7-e20eba61aa47 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:49.718256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:49.719949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:49.720620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:49.721293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] PATH_INFO: `/v3/projects/706f7f0afb0146ae8ff070db5fe5b407` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:49.723456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706f7f0afb0146ae8ff070db5fe5b407)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:49.741807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:49.911512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706f7f0afb0146ae8ff070db5fe5b407', 'request_id': 'req-06707f6b-032a-4dee-993a-46b78c9f3801'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:49.917154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706f7f0afb0146ae8ff070db5fe5b407', 'request_id': 'req-06707f6b-032a-4dee-993a-46b78c9f3801'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:49.959337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca71c-59fd-4269-8559-53044a047bf5 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:49.959857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca71c-59fd-4269-8559-53044a047bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:49.959857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bca71c-59fd-4269-8559-53044a047bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:49.988592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-78bca71c-59fd-4269-8559-53044a047bf5 None None] MFA Rules not processed for user `4206483570704442b478d91317d1b491`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:49.994162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-78bca71c-59fd-4269-8559-53044a047bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:50.059466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706f7f0afb0146ae8ff070db5fe5b407', 'request_id': 'req-06707f6b-032a-4dee-993a-46b78c9f3801'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.071822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1052/2100] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:50.095024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] The token cache is being invalidate because project 706f7f0afb0146ae8ff070db5fe5b407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:50.095024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.095024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.095024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1049/2101] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:49 2022] DELETE /identity/v3/projects/706f7f0afb0146ae8ff070db5fe5b407 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:50.095460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bca71c-59fd-4269-8559-53044a047bf5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:50.095546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:50.095546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:50.146586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bca71c-59fd-4269-8559-53044a047bf5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:50.147893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707f6b-032a-4dee-993a-46b78c9f3801 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:50.151643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:50.151775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:50.152294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:50.152510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:50.152626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:50.152785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:50.152880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:50.153063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] PATH_INFO: `/v3/users/4b133851a5e14e40b2ca77e687ec1a24` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:50.154293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b133851a5e14e40b2ca77e687ec1a24)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:50.154617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:50.156580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:50.165713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:50.167267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:50.177914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1050/2102] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:50.504092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b133851a5e14e40b2ca77e687ec1a24'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.511525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b133851a5e14e40b2ca77e687ec1a24'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.607996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b133851a5e14e40b2ca77e687ec1a24'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.608725 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b133851a5e14e40b2ca77e687ec1a24'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.624329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b133851a5e14e40b2ca77e687ec1a24'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:50.631936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1053/2103] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:50 2022] DELETE /identity/v3/users/4b133851a5e14e40b2ca77e687ec1a24 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:51.229374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:51.231063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:51.250228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d04475-eab2-4980-9a47-08efd4fbbd4a service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:51.318232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:51.319130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:51.319422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:51.319710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] PATH_INFO: `/v3/projects/2012603461ee412f9331f0711b38193f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:51.320992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2012603461ee412f9331f0711b38193f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:51.323264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:51.347730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:51.349289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:51.404522 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee4d0-812b-4da2-b54c-44936798086f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:51.408105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:51.408739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:51.409016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:51.409287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:51.411055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:51.454970 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2012603461ee412f9331f0711b38193f', 'request_id': 'req-f552452c-665e-426c-bd88-455d806ee152'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:51.460548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2012603461ee412f9331f0711b38193f', 'request_id': 'req-f552452c-665e-426c-bd88-455d806ee152'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:51.468572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:51.470074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:51.478699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1054/2104] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:54:51.567598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2012603461ee412f9331f0711b38193f', 'request_id': 'req-f552452c-665e-426c-bd88-455d806ee152'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:51.579507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] The token cache is being invalidate because project 2012603461ee412f9331f0711b38193f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:51.579795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:51.580443 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:51.581977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1051/2105] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:51 2022] DELETE /identity/v3/projects/2012603461ee412f9331f0711b38193f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:54:51.585958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:51.587385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:51.600976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5f830-624b-4d5e-af3a-041d91a45317 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:51.654845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:51.655705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:51.655984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:51.656257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] PATH_INFO: `/v3/users/06d4f259285b466a893eeff1536c1263` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:51.657471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d4f259285b466a893eeff1536c1263)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:51.659467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:51.881460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d4f259285b466a893eeff1536c1263'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:51.888705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d4f259285b466a893eeff1536c1263'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.036069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d4f259285b466a893eeff1536c1263'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.036694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d4f259285b466a893eeff1536c1263'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.048697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-469c3b50-7595-4007-8411-42aa1ce4e724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d4f259285b466a893eeff1536c1263'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.054683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1055/2106] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:54:51 2022] DELETE /identity/v3/users/06d4f259285b466a893eeff1536c1263 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:52.466293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:52.468378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:52.486365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552452c-665e-426c-bd88-455d806ee152 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:52.549073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:52.549871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:52.550146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:52.550415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] PATH_INFO: `/v3/projects/74ae07b973714c57bbd4910b7d7ed834` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:52.551634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ae07b973714c57bbd4910b7d7ed834)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:52.553532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:52.685691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ae07b973714c57bbd4910b7d7ed834', 'request_id': 'req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.690983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ae07b973714c57bbd4910b7d7ed834', 'request_id': 'req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.767700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ae07b973714c57bbd4910b7d7ed834', 'request_id': 'req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.778981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] The token cache is being invalidate because project 74ae07b973714c57bbd4910b7d7ed834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:54:52.779271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.779906 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c11f7ac7-3d85-4691-8b3c-c5b112f0268a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:54:52.781461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1052/2107] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:54:52 2022] DELETE /identity/v3/projects/74ae07b973714c57bbd4910b7d7ed834 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:52.788315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1863b6-cd20-4e20-a8b3-2e0aaa74fb3b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:52.788847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1863b6-cd20-4e20-a8b3-2e0aaa74fb3b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:52.788926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1863b6-cd20-4e20-a8b3-2e0aaa74fb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:52.806224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-fb1863b6-cd20-4e20-a8b3-2e0aaa74fb3b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:52.807381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fb1863b6-cd20-4e20-a8b3-2e0aaa74fb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:52.864239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1056/2108] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:52.873733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4f64-e85d-491c-8139-108cdea8253c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:52.874017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4f64-e85d-491c-8139-108cdea8253c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:52.874315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4f64-e85d-491c-8139-108cdea8253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:52.894277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d27d4f64-e85d-491c-8139-108cdea8253c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:52.895523 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d27d4f64-e85d-491c-8139-108cdea8253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:52.905586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1053/2109] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:52.912210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1863b6-cd20-4e20-a8b3-2e0aaa74fb3b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:52.922073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1863b6-cd20-4e20-a8b3-2e0aaa74fb3b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:52.926879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:52.927529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:52.927808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:52.928082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:52.928818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:54:52.929122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:52.930740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:52.942599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1057/2110] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:54:52.947061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4f64-e85d-491c-8139-108cdea8253c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:52.956600 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4f64-e85d-491c-8139-108cdea8253c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:52.961204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:52.961839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:52.962120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:52.962392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:52.963129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:52.965040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:53.037349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1054/2111] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:54:52 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:53.041489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:53.052180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2dc2-2406-4ef9-a059-7c5cd966ab38 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:53.105640 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:53.106300 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:53.106579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:53.106920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:53.108147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:53.110040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:53.179034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1058/2112] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:54:53 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:54:53.183786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:53.193881 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eacd6a-0abc-4774-bf2f-60b15655127a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:53.198608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:53.199286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:53.199572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:53.199850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:53.201126 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:53.202758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:53.213404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1055/2113] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:53.218002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:53.235323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b595b4-1d64-4423-9b9e-25d5473a3d94 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:53.239936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9642-9b5b-43c1-8150-30f86cec60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:53.240594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9642-9b5b-43c1-8150-30f86cec60c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:53.240872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9642-9b5b-43c1-8150-30f86cec60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:53.241145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9642-9b5b-43c1-8150-30f86cec60c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:53.241886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be9642-9b5b-43c1-8150-30f86cec60c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:53.243629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be9642-9b5b-43c1-8150-30f86cec60c4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:53.254363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1059/2114] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:54:53.258948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:53.273017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddda2-b90a-477d-9dea-07b3fe9e768c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:53.277855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:53.278744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:53.279606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:53.279883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] PATH_INFO: `/v3/projects/690b275911a04e229380b5b114997072/users/ea26d06ecbae4ea88d0aad26ff924a27/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:53.293668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690b275911a04e229380b5b114997072, user_id=ea26d06ecbae4ea88d0aad26ff924a27, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:53.296331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:53.367803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1056/2115] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:54:53 2022] PUT /identity/v3/projects/690b275911a04e229380b5b114997072/users/ea26d06ecbae4ea88d0aad26ff924a27/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:54:53.378106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:53.378392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:53.378667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:53.405012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] MFA Rules not processed for user `ea26d06ecbae4ea88d0aad26ff924a27`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:53.406181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:53.464573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1060/2116] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:54:53.476596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:53.478263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:53.532890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d5fc-bac9-4f63-b34c-c21f7fe2a1f0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:53.536593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4ed0a-4045-4391-9e0e-20f59bf3847a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:53.537225 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4ed0a-4045-4391-9e0e-20f59bf3847a service glance] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:53.537507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4ed0a-4045-4391-9e0e-20f59bf3847a service glance] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:53.537781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4ed0a-4045-4391-9e0e-20f59bf3847a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:53.545996 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4ed0a-4045-4391-9e0e-20f59bf3847a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:53.547456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4ed0a-4045-4391-9e0e-20f59bf3847a service glance] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:53.558367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1057/2117] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:54.982851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:54:54.984377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:55.039222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881761d-4c7c-4f10-a00f-388a4f17bafe None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:54:55.042753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:54:55.043408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:55.043688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:55.043960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:55.046244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:55.104873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:54:55.106307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:54:55.115702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1061/2118] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:54:56.681268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981408e-c0ed-4356-a6c3-6d10853781dd None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:54:56.681903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981408e-c0ed-4356-a6c3-6d10853781dd None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:54:56.681903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981408e-c0ed-4356-a6c3-6d10853781dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:54:56.723977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-8981408e-c0ed-4356-a6c3-6d10853781dd None None] MFA Rules not processed for user `4206483570704442b478d91317d1b491`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:54:56.725299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8981408e-c0ed-4356-a6c3-6d10853781dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:54:56.791981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1058/2119] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:54:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:55:02.478862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:55:02.480365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:02.545141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee35b0f-e306-4339-b634-67ba5e0f5c79 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:55:02.550082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:55:02.552265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:02.552265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:02.552265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] PATH_INFO: `/v3/users/b3175ddde1c545dabb8d588f2f3eba0b` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:02.552701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3175ddde1c545dabb8d588f2f3eba0b)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:55:02.554624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:55:02.849356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3175ddde1c545dabb8d588f2f3eba0b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:02.857298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3175ddde1c545dabb8d588f2f3eba0b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:02.972131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3175ddde1c545dabb8d588f2f3eba0b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:02.972824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3175ddde1c545dabb8d588f2f3eba0b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:02.987123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3175ddde1c545dabb8d588f2f3eba0b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:02.994965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1062/2120] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:55:02 2022] DELETE /identity/v3/users/b3175ddde1c545dabb8d588f2f3eba0b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:55:03.000273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:03.000810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:03.000928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:03.025837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:55:03.027759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:03.093958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1059/2121] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:55:03.110785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:55:03.112510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:03.182989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de8f8-2ee8-4cd8-9738-bd3e79d6ccd7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:55:03.187573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:55:03.188235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:03.188520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:03.188800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:03.206181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:55:03.214476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:55:03.226789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1063/2122] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:55:03.866664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:55:03.868307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:03.885178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdba12-eaa4-45aa-b074-ada645157bf5 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:55:03.890483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:55:03.891796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:03.892430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:03.893421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] PATH_INFO: `/v3/projects/7ad7fc2c600d4ead8797b23617aef25b` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:03.894959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad7fc2c600d4ead8797b23617aef25b)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:55:03.898788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:55:04.113581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad7fc2c600d4ead8797b23617aef25b', 'request_id': 'req-86e0d0e5-d45d-4964-8635-f43cf977f33d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.136799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad7fc2c600d4ead8797b23617aef25b', 'request_id': 'req-86e0d0e5-d45d-4964-8635-f43cf977f33d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.273647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad7fc2c600d4ead8797b23617aef25b', 'request_id': 'req-86e0d0e5-d45d-4964-8635-f43cf977f33d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.302416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] The token cache is being invalidate because project 7ad7fc2c600d4ead8797b23617aef25b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:55:04.303260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.304109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.305985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1060/2123] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:55:03 2022] DELETE /identity/v3/projects/7ad7fc2c600d4ead8797b23617aef25b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:55:04.310623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:55:04.322294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf278a05-7101-450b-a989-bbdac2090b5f service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:55:04.397894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:55:04.397894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:04.397894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:04.397894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] PATH_INFO: `/v3/users/b5a0c47186f445ba8a17d7c8251eb037` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:04.398492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a0c47186f445ba8a17d7c8251eb037)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:55:04.398492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:55:04.684573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a0c47186f445ba8a17d7c8251eb037'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.692289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a0c47186f445ba8a17d7c8251eb037'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.801457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a0c47186f445ba8a17d7c8251eb037'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.802140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a0c47186f445ba8a17d7c8251eb037'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.815216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a0c47186f445ba8a17d7c8251eb037'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:04.821749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1064/2124] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:55:04 2022] DELETE /identity/v3/users/b5a0c47186f445ba8a17d7c8251eb037 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:55:05.587372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:55:05.589165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:05.604060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0d0e5-d45d-4964-8635-f43cf977f33d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:55:05.662585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:55:05.663727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:05.664097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:05.664417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] PATH_INFO: `/v3/projects/0bcbc975f01e49f8bc403791fa212071` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:05.665845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcbc975f01e49f8bc403791fa212071)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:55:05.667877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:55:05.767323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcbc975f01e49f8bc403791fa212071', 'request_id': 'req-23f358f9-b557-4dd3-b3b2-2a667223949d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:05.773403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcbc975f01e49f8bc403791fa212071', 'request_id': 'req-23f358f9-b557-4dd3-b3b2-2a667223949d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:05.852691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcbc975f01e49f8bc403791fa212071', 'request_id': 'req-23f358f9-b557-4dd3-b3b2-2a667223949d'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:05.866497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] The token cache is being invalidate because project 0bcbc975f01e49f8bc403791fa212071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:55:05.866817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:05.867477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:05.869256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1061/2125] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:55:05 2022] DELETE /identity/v3/projects/0bcbc975f01e49f8bc403791fa212071 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:55:05.873733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:55:05.875321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:05.888004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844aca2-a978-47d8-8ae9-2961dc051451 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:55:05.947692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:55:05.948578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:05.948860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:05.949133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] PATH_INFO: `/v3/users/dc925f6f3e0544eeb088e3e71b393714` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:05.950409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc925f6f3e0544eeb088e3e71b393714)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:55:05.952415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:55:06.188061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc925f6f3e0544eeb088e3e71b393714'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:06.195003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc925f6f3e0544eeb088e3e71b393714'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:06.326871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc925f6f3e0544eeb088e3e71b393714'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:06.327492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc925f6f3e0544eeb088e3e71b393714'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:06.341242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1416aa7f-af77-4958-82ef-233d47aebeb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc925f6f3e0544eeb088e3e71b393714'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:06.347285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1065/2126] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:55:05 2022] DELETE /identity/v3/users/dc925f6f3e0544eeb088e3e71b393714 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:55:06.878936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:55:06.880528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:06.894530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f358f9-b557-4dd3-b3b2-2a667223949d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:55:06.952236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:55:06.953096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:06.953376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:06.953647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] PATH_INFO: `/v3/projects/51f6581c62e74cd98f9bd81e08ba4be4` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:06.954872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f6581c62e74cd98f9bd81e08ba4be4)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:55:06.956770 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:55:07.075919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f6581c62e74cd98f9bd81e08ba4be4', 'request_id': 'req-7cf12492-cc31-4f5c-8385-a24bcd5662d3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:07.078404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f6581c62e74cd98f9bd81e08ba4be4', 'request_id': 'req-7cf12492-cc31-4f5c-8385-a24bcd5662d3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:07.172891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f6581c62e74cd98f9bd81e08ba4be4', 'request_id': 'req-7cf12492-cc31-4f5c-8385-a24bcd5662d3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:07.184963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] The token cache is being invalidate because project 51f6581c62e74cd98f9bd81e08ba4be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:55:07.190395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:07.190395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7cf12492-cc31-4f5c-8385-a24bcd5662d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:55:07.190395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1062/2127] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:55:06 2022] DELETE /identity/v3/projects/51f6581c62e74cd98f9bd81e08ba4be4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:55:21.227395 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:21.227880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:21.228064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:21.244656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] MFA Rules not processed for user `4206483570704442b478d91317d1b491`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:55:21.246091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:21.297781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1066/2128] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:55:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:55:43.694856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eee117-677b-4f69-b776-8eb4ea48b890 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:55:43.694856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eee117-677b-4f69-b776-8eb4ea48b890 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:55:43.694856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eee117-677b-4f69-b776-8eb4ea48b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:55:43.712975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-81eee117-677b-4f69-b776-8eb4ea48b890 None None] MFA Rules not processed for user `f12d89fe1feb44c094e1321c41deac60`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:55:43.714175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-81eee117-677b-4f69-b776-8eb4ea48b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:55:43.767683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1063/2129] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:55:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:06.679293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:06.680719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:06.805877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd36f48-5122-45c7-95d6-5f8219f1c12b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:06.810772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:06.811634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:06.811919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:06.812195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] PATH_INFO: `/v3/users/60b9844d6ecd4915ae25ce8014fbd2a7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:06.813440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b9844d6ecd4915ae25ce8014fbd2a7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:06.815442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:07.025530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b9844d6ecd4915ae25ce8014fbd2a7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:07.032721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b9844d6ecd4915ae25ce8014fbd2a7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:07.124585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b9844d6ecd4915ae25ce8014fbd2a7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:07.125226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b9844d6ecd4915ae25ce8014fbd2a7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:07.136737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b9844d6ecd4915ae25ce8014fbd2a7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:07.142547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1067/2130] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:06 2022] DELETE /identity/v3/users/60b9844d6ecd4915ae25ce8014fbd2a7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:07.147138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:07.147619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:07.147711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:07.174042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:07.175227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:07.230081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1064/2131] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:07.239612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:07.241046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:07.331838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47170f-26b9-46b0-a815-7ebc6a719f5d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:07.335461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:07.336103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:07.336392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:07.336668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:07.346201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:07.347667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:07.357422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1068/2132] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:07.754719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:07.756175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:07.770489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d848e0d-e6c7-476b-b012-c129b5158f67 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:07.772983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:07.773836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:07.774120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:07.774395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] PATH_INFO: `/v3/projects/e0c593de1c1e433b86eea90784cfd224` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:07.775634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c593de1c1e433b86eea90784cfd224)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:07.777545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:07.884474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c593de1c1e433b86eea90784cfd224', 'request_id': 'req-95b856f6-014a-4b8a-9fc2-aecca1c5229f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:07.890231 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c593de1c1e433b86eea90784cfd224', 'request_id': 'req-95b856f6-014a-4b8a-9fc2-aecca1c5229f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.016306 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c593de1c1e433b86eea90784cfd224', 'request_id': 'req-95b856f6-014a-4b8a-9fc2-aecca1c5229f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.028400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] The token cache is being invalidate because project e0c593de1c1e433b86eea90784cfd224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:08.028689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.029335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.030875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1065/2133] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:07 2022] DELETE /identity/v3/projects/e0c593de1c1e433b86eea90784cfd224 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:08.034763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:08.044485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286871f4-e961-4384-ada6-77f9edad9ea1 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:08.099099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:08.099956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:08.100240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:08.100507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] PATH_INFO: `/v3/users/3cd2d60ef5784e46a8eafb212bc90abb` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:08.101689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd2d60ef5784e46a8eafb212bc90abb)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:08.103787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:08.366652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd2d60ef5784e46a8eafb212bc90abb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.373732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd2d60ef5784e46a8eafb212bc90abb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.456305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd2d60ef5784e46a8eafb212bc90abb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.456925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd2d60ef5784e46a8eafb212bc90abb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.469386 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-476df90a-3c42-4d27-a121-ef303fa52b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd2d60ef5784e46a8eafb212bc90abb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:08.475184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1069/2134] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:08 2022] DELETE /identity/v3/users/3cd2d60ef5784e46a8eafb212bc90abb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:08.887263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:08.900902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:08.904153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b856f6-014a-4b8a-9fc2-aecca1c5229f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:08.960043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:08.960926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:08.961207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:08.961480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] PATH_INFO: `/v3/projects/e50d20422f544cb486304ab3e8064830` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:08.962690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50d20422f544cb486304ab3e8064830)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:08.964660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:09.090133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50d20422f544cb486304ab3e8064830', 'request_id': 'req-834dae62-1d97-40f3-b3bf-e776e12bf5db'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:09.095493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50d20422f544cb486304ab3e8064830', 'request_id': 'req-834dae62-1d97-40f3-b3bf-e776e12bf5db'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:09.164440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50d20422f544cb486304ab3e8064830', 'request_id': 'req-834dae62-1d97-40f3-b3bf-e776e12bf5db'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:09.175977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] The token cache is being invalidate because project e50d20422f544cb486304ab3e8064830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:09.176257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:09.176881 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-834dae62-1d97-40f3-b3bf-e776e12bf5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:09.178475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1066/2135] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:08 2022] DELETE /identity/v3/projects/e50d20422f544cb486304ab3e8064830 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:09.185074 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5feb76-89d5-4b61-9a63-38f77405600b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.185587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5feb76-89d5-4b61-9a63-38f77405600b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.185681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5feb76-89d5-4b61-9a63-38f77405600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.220918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-3a5feb76-89d5-4b61-9a63-38f77405600b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:09.222116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3a5feb76-89d5-4b61-9a63-38f77405600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:09.278420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1070/2136] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:09.285892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd06d-254b-4961-b0a1-86b97b479150 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.286181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd06d-254b-4961-b0a1-86b97b479150 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.286457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd06d-254b-4961-b0a1-86b97b479150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.304617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-adabd06d-254b-4961-b0a1-86b97b479150 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:09.305789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-adabd06d-254b-4961-b0a1-86b97b479150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:09.313484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1067/2137] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:09.317518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5feb76-89d5-4b61-9a63-38f77405600b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:09.327392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5feb76-89d5-4b61-9a63-38f77405600b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:09.340183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:09.343381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.343381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.343381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.343381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:09.343381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:09.344092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:09.356675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1071/2138] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:56:09.361187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd06d-254b-4961-b0a1-86b97b479150 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:09.370912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd06d-254b-4961-b0a1-86b97b479150 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:09.375578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:09.376253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.376537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.376811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.377544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:09.379510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:09.458712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1068/2139] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:09 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:09.462931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:09.473560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f3d69-fd89-461a-9cf6-473c77299f0d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:09.528715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:09.529373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.529654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.529927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.530662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:09.532599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:09.657075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1072/2140] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:09 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:09.661372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:09.671534 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd658-f3e9-41e8-9b12-9eefb6568af9 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:09.676180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:09.676828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.677111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.677387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.678162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:09.679792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:09.691008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1069/2141] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:09.695010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:09.705229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6326665-ed36-4668-ace1-39fc90748501 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:09.709964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593432b8-d890-43d0-b4f7-41bd0f066a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:09.710550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593432b8-d890-43d0-b4f7-41bd0f066a08 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.710877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593432b8-d890-43d0-b4f7-41bd0f066a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.711156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593432b8-d890-43d0-b4f7-41bd0f066a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.711894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593432b8-d890-43d0-b4f7-41bd0f066a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:09.714124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593432b8-d890-43d0-b4f7-41bd0f066a08 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:09.723683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1073/2142] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:09.727590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:09.737169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00e3c8-70fd-427c-8831-beecdc59e721 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:09.741740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:09.742595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.742919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.743198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] PATH_INFO: `/v3/projects/c39adca7a47a4e9d9d76f95bd7b2654c/users/21c8a11be1024000a49906d8d8cd7fca/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.757337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39adca7a47a4e9d9d76f95bd7b2654c, user_id=21c8a11be1024000a49906d8d8cd7fca, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:09.760010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:09.884124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1070/2143] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:09 2022] PUT /identity/v3/projects/c39adca7a47a4e9d9d76f95bd7b2654c/users/21c8a11be1024000a49906d8d8cd7fca/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:09.895414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f13d28-31fb-4386-8412-51e4bb303c1d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:09.895709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f13d28-31fb-4386-8412-51e4bb303c1d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:09.896019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f13d28-31fb-4386-8412-51e4bb303c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:09.925111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a1f13d28-31fb-4386-8412-51e4bb303c1d None None] MFA Rules not processed for user `21c8a11be1024000a49906d8d8cd7fca`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:09.926326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a1f13d28-31fb-4386-8412-51e4bb303c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:09.988494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1074/2144] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:09.992912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:10.051739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5b0cd-4989-484f-8d20-c94a0987ad40 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:10.056337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:10.056984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.057256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.057527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.058226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:10.060127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:10.142471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1071/2145] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:09 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:10.146382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f13d28-31fb-4386-8412-51e4bb303c1d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:10.157064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f13d28-31fb-4386-8412-51e4bb303c1d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:10.210452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:10.211144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.211425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.211694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.212388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:10.214840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:10.330290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1075/2146] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:10 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:10.334124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:10.344380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50249691-3766-4eb6-86ad-a9e351aae5cc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:10.348978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:10.349627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.349906 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.350176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.350971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:10.352557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:10.363200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1072/2147] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:10.367449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:10.378136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f0ed1-e75a-43d9-ad81-87b9b1e0edff admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:10.382871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:10.383741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.384022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.384292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] PATH_INFO: `/v3/projects/95f08b5bdf244153b2d822908dffda7f/users/33ebcdffffcf48fbbb235c6a4e0959a3/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.398906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f08b5bdf244153b2d822908dffda7f, user_id=33ebcdffffcf48fbbb235c6a4e0959a3, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:10.401564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:10.507792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1076/2148] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:10 2022] PUT /identity/v3/projects/95f08b5bdf244153b2d822908dffda7f/users/33ebcdffffcf48fbbb235c6a4e0959a3/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:10.515713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:10.525430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710269e-cd34-46db-a3fc-2734f7ad3cd4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:10.577694 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e28d8-30ec-4749-88c0-ef39bc31f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:10.578347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e28d8-30ec-4749-88c0-ef39bc31f567 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.578631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e28d8-30ec-4749-88c0-ef39bc31f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.578937 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e28d8-30ec-4749-88c0-ef39bc31f567 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.579668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e28d8-30ec-4749-88c0-ef39bc31f567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:10.581313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e28d8-30ec-4749-88c0-ef39bc31f567 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:10.590903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1073/2149] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:10.594757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:10.605366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305a71-d2a2-4814-8684-5b8bc7e6dfab admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:10.609909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:10.610821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.611106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.611379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] PATH_INFO: `/v3/projects/95f08b5bdf244153b2d822908dffda7f/users/33ebcdffffcf48fbbb235c6a4e0959a3/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.613334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f08b5bdf244153b2d822908dffda7f, user_id=33ebcdffffcf48fbbb235c6a4e0959a3, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:10.615949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:10.626714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1077/2150] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:10 2022] PUT /identity/v3/projects/95f08b5bdf244153b2d822908dffda7f/users/33ebcdffffcf48fbbb235c6a4e0959a3/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:10.636464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad744b-eddf-4812-af1d-779d8db7555d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.636756 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad744b-eddf-4812-af1d-779d8db7555d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.637034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad744b-eddf-4812-af1d-779d8db7555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.662193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-73ad744b-eddf-4812-af1d-779d8db7555d None None] MFA Rules not processed for user `33ebcdffffcf48fbbb235c6a4e0959a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:10.663451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-73ad744b-eddf-4812-af1d-779d8db7555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:10.729503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1074/2151] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:10.739924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:10.741662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:10.796268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff5411-9f87-442a-bf8b-6ee10c1f7a06 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:10.799922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46748af1-3bf9-4260-9162-62e480be7ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:10.800550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748af1-3bf9-4260-9162-62e480be7ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:10.800831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748af1-3bf9-4260-9162-62e480be7ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:10.801105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748af1-3bf9-4260-9162-62e480be7ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:10.809931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46748af1-3bf9-4260-9162-62e480be7ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:10.811387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46748af1-3bf9-4260-9162-62e480be7ba5 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:10.820505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1078/2152] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:11.109001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad744b-eddf-4812-af1d-779d8db7555d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:11.118944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad744b-eddf-4812-af1d-779d8db7555d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:11.123386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:11.124721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:11.125111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:11.125499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:11.198154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:11.199975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:11.210436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1075/2153] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:12.736891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:12.737326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:12.737577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:12.759453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:12.760848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:12.823821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1079/2154] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:56:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:12.865519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:12.867018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:12.943398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec1f1-6835-40ae-bc92-60251eeb3366 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:12.949037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef9a12-3b7a-4be5-bf41-23d7008bb0c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:12.949697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef9a12-3b7a-4be5-bf41-23d7008bb0c0 service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:12.949982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef9a12-3b7a-4be5-bf41-23d7008bb0c0 service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:12.950264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef9a12-3b7a-4be5-bf41-23d7008bb0c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:12.959041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef9a12-3b7a-4be5-bf41-23d7008bb0c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:12.960625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef9a12-3b7a-4be5-bf41-23d7008bb0c0 service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:12.968845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1076/2155] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:56:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:56:14.002605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:14.004879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:14.168132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc98ab1-15f6-45d8-9955-b7bf184772d4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:14.174375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:14.175549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:14.176036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:14.176420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] PATH_INFO: `/v3/users/ea26d06ecbae4ea88d0aad26ff924a27` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:14.177894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea26d06ecbae4ea88d0aad26ff924a27)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:14.180133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:14.505336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea26d06ecbae4ea88d0aad26ff924a27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:14.544588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea26d06ecbae4ea88d0aad26ff924a27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:14.644855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea26d06ecbae4ea88d0aad26ff924a27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:14.645475 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea26d06ecbae4ea88d0aad26ff924a27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:14.672109 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea26d06ecbae4ea88d0aad26ff924a27'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:14.684737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1080/2156] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:14 2022] DELETE /identity/v3/users/ea26d06ecbae4ea88d0aad26ff924a27 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:14.686766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:14.687262 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:14.687347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:14.707083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:14.708358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:14.785159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1077/2157] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:14.795948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:14.797486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:14.874272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d658a-ebe6-4788-a5f7-a2ac944061d9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:14.887442 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:14.888173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:14.888558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:14.888836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:14.903206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:14.904974 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:14.917483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1081/2158] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:15.624588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:15.630851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:15.668182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a7ea-168c-4874-af9c-ce49437f3ed2 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:15.677286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:15.682278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:15.682569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:15.682879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] PATH_INFO: `/v3/projects/690b275911a04e229380b5b114997072` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:15.687820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690b275911a04e229380b5b114997072)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:15.706439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:15.954187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690b275911a04e229380b5b114997072', 'request_id': 'req-3ced7707-2761-4f6c-85ce-73486993b2e0'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:15.960435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690b275911a04e229380b5b114997072', 'request_id': 'req-3ced7707-2761-4f6c-85ce-73486993b2e0'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:16.073592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690b275911a04e229380b5b114997072', 'request_id': 'req-3ced7707-2761-4f6c-85ce-73486993b2e0'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:16.085674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] The token cache is being invalidate because project 690b275911a04e229380b5b114997072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:16.086029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:16.086835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3ced7707-2761-4f6c-85ce-73486993b2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:16.089513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1078/2159] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:15 2022] DELETE /identity/v3/projects/690b275911a04e229380b5b114997072 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:29.731978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:29.733464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:29.746275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0dcf0-01d5-4bfa-90ee-e68ad794c9be service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:29.800606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:29.801404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:29.801687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:29.801950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] PATH_INFO: `/v3/users/21c8a11be1024000a49906d8d8cd7fca` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:29.803242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c8a11be1024000a49906d8d8cd7fca)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:29.805141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:30.031152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c8a11be1024000a49906d8d8cd7fca'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:30.039546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c8a11be1024000a49906d8d8cd7fca'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:30.107083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c8a11be1024000a49906d8d8cd7fca'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:30.107701 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c8a11be1024000a49906d8d8cd7fca'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:30.119635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c8a11be1024000a49906d8d8cd7fca'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:30.125465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1082/2160] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:29 2022] DELETE /identity/v3/users/21c8a11be1024000a49906d8d8cd7fca => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:30.133492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:30.133492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:30.133492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:30.150999 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:30.152207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:30.212573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1079/2161] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:30.222351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:30.233373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:30.279327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885282d-33f1-4837-b6b1-b0d229ede395 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:30.282954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:30.283590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:30.283868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:30.284141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:30.293346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:30.294790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:30.303951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1083/2162] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:30.765319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:30.766760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:30.779653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54881d22-b672-432f-ae11-b4e77dddd4a7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:30.784237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:30.785092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:30.785368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:30.785640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] PATH_INFO: `/v3/projects/c39adca7a47a4e9d9d76f95bd7b2654c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:30.787558 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39adca7a47a4e9d9d76f95bd7b2654c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:30.789920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:30.932195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39adca7a47a4e9d9d76f95bd7b2654c', 'request_id': 'req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:30.937435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39adca7a47a4e9d9d76f95bd7b2654c', 'request_id': 'req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.021885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39adca7a47a4e9d9d76f95bd7b2654c', 'request_id': 'req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.036903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] The token cache is being invalidate because project c39adca7a47a4e9d9d76f95bd7b2654c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:31.037188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.037836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-8f14fa0b-0c32-4f53-8d7f-63c5a42edd3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.039414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1080/2163] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:30 2022] DELETE /identity/v3/projects/c39adca7a47a4e9d9d76f95bd7b2654c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:31.044203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:31.054605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8433a2-acff-4411-9adb-6829bdafe6b1 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:31.109768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:31.110967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:31.111244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:31.111936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] PATH_INFO: `/v3/users/33ebcdffffcf48fbbb235c6a4e0959a3` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:31.112841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ebcdffffcf48fbbb235c6a4e0959a3)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:31.114744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:31.158590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:31.159151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:31.159151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:31.187248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:31.188434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:31.240923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1081/2164] 10.222.0.88 () {58 vars in 967 bytes} [Mon Jan 17 09:56:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:31.253529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:31.254945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:31.300373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ebcdffffcf48fbbb235c6a4e0959a3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.307643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ebcdffffcf48fbbb235c6a4e0959a3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.325902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631cddf-16ab-4908-a041-091d8cb6d39b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:31.331441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:31.337296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:31.337296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:31.337296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:31.342403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:31.344026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:31.357059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1082/2165] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:56:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:56:31.393735 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ebcdffffcf48fbbb235c6a4e0959a3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.395418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ebcdffffcf48fbbb235c6a4e0959a3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.415456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cad833a1-cb9d-40bf-8575-f653401c6aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ebcdffffcf48fbbb235c6a4e0959a3'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:31.423657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1084/2166] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:31 2022] DELETE /identity/v3/users/33ebcdffffcf48fbbb235c6a4e0959a3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:32.012687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:32.014344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:32.031732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050255f-7402-4f69-b245-049bde4c8acc service swift] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:32.104818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:32.105806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:32.105952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:32.106248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] PATH_INFO: `/v3/projects/95f08b5bdf244153b2d822908dffda7f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:32.107444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f08b5bdf244153b2d822908dffda7f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:32.109348 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:32.335077 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f08b5bdf244153b2d822908dffda7f', 'request_id': 'req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:32.340436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f08b5bdf244153b2d822908dffda7f', 'request_id': 'req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:32.444155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f08b5bdf244153b2d822908dffda7f', 'request_id': 'req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:32.456652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] The token cache is being invalidate because project 95f08b5bdf244153b2d822908dffda7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:32.456945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:32.457579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-196c04f0-45d6-4793-ab89-ed7cc3df7aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:32.459292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1083/2167] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:32 2022] DELETE /identity/v3/projects/95f08b5bdf244153b2d822908dffda7f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:32.465139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96daa0-2a42-4b39-8cc2-ceee6ad7aa3c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:32.465605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96daa0-2a42-4b39-8cc2-ceee6ad7aa3c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:32.465806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96daa0-2a42-4b39-8cc2-ceee6ad7aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:32.494930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4f96daa0-2a42-4b39-8cc2-ceee6ad7aa3c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:32.496122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4f96daa0-2a42-4b39-8cc2-ceee6ad7aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:32.556203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1085/2168] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:32.564390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e996-7fcf-4fc4-9a00-8479caa3297e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:32.565180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e996-7fcf-4fc4-9a00-8479caa3297e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:32.565180 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e996-7fcf-4fc4-9a00-8479caa3297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:32.596142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c357e996-7fcf-4fc4-9a00-8479caa3297e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:32.597357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c357e996-7fcf-4fc4-9a00-8479caa3297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:32.606503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1084/2169] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:32.610687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96daa0-2a42-4b39-8cc2-ceee6ad7aa3c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:32.621361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96daa0-2a42-4b39-8cc2-ceee6ad7aa3c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:32.627199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:32.627844 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:32.628158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:32.628419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:32.629173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:32.629482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:32.631222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:32.646551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1086/2170] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:56:32.647747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357e996-7fcf-4fc4-9a00-8479caa3297e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:32.657578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357e996-7fcf-4fc4-9a00-8479caa3297e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:32.663943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:32.664782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:32.665226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:32.666201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:32.667275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:32.669953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:32.786013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1085/2171] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:32 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:32.787588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:32.797795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3455c-178a-4c4e-b9c0-114fbc947f09 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:32.854035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:32.854723 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:32.855032 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:32.855307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:32.856147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:32.858070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:32.953460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1087/2172] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:32 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:32.964049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:32.968219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:32.970106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:32.974209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884055-3642-4106-ba3c-657f4d0198b2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:32.979520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:32.980183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:32.980466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:32.980739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:32.981480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:32.983115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:32.994342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1086/2173] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:32.998419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:33.010820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284145-f37c-4611-a017-ab3edc8b80b4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:33.028514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:33.028514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.028514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.028514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.029257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:33.030885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:33.041987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1087/2174] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:33.056236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:33.066711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2b423-30d1-4b60-a744-98c6cd36ca82 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:33.071459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:33.072445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.072730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7d204-c220-4e27-8102-bbe11049e4b4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:33.072836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.073193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] PATH_INFO: `/v3/projects/0a30555c8d0d47eba75893e70dda6d26/users/1a9ce4dff1bd4ee59a470e712b235bbc/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.078761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac847b-230b-4a7d-9f85-88aa9e47e484 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:33.079405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac847b-230b-4a7d-9f85-88aa9e47e484 service placement] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.088419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac847b-230b-4a7d-9f85-88aa9e47e484 service placement] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.088419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac847b-230b-4a7d-9f85-88aa9e47e484 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.088419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-00ac847b-230b-4a7d-9f85-88aa9e47e484 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:33.088712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a30555c8d0d47eba75893e70dda6d26, user_id=1a9ce4dff1bd4ee59a470e712b235bbc, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:33.090663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:33.093019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac847b-230b-4a7d-9f85-88aa9e47e484 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:33.094586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac847b-230b-4a7d-9f85-88aa9e47e484 service placement] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:33.104796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1088/2175] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:33.198545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1088/2176] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:33 2022] PUT /identity/v3/projects/0a30555c8d0d47eba75893e70dda6d26/users/1a9ce4dff1bd4ee59a470e712b235bbc/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:33.209690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027708e-d399-43b4-a860-1aab13f1dfab None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.209968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027708e-d399-43b4-a860-1aab13f1dfab None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.210243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027708e-d399-43b4-a860-1aab13f1dfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.235966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a027708e-d399-43b4-a860-1aab13f1dfab None None] MFA Rules not processed for user `1a9ce4dff1bd4ee59a470e712b235bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:33.237148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a027708e-d399-43b4-a860-1aab13f1dfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:33.311362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1089/2177] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:33.315748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:33.388239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cced544-dee2-41ef-9e37-56fded1fdc2f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:33.393399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:33.394127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.394477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.394919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.395721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:33.397814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:33.533738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1089/2178] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:33 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:33.537419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027708e-d399-43b4-a860-1aab13f1dfab None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:33.549879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027708e-d399-43b4-a860-1aab13f1dfab None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:33.608379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:33.609051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.609335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.609610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.610372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:33.612367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:33.723145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1090/2179] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:33 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:33.726805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:33.738641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dcadb-46a9-49df-886e-19ea637671ed admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:33.743893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:33.744552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.744849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.745138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.745945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:33.747592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:33.759920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1090/2180] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:33.763950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:33.773928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ee23e-6ec9-4f31-81d2-908725a8a206 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:33.779378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:33.784151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:33.784402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:33.784683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] PATH_INFO: `/v3/projects/17e317e83c004f788d2a0fb7f63c9fba/users/c31fa5e5f30346fbb66edc573f53fa29/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:33.800154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e317e83c004f788d2a0fb7f63c9fba, user_id=c31fa5e5f30346fbb66edc573f53fa29, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:33.802836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:33.963337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1091/2181] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:33 2022] PUT /identity/v3/projects/17e317e83c004f788d2a0fb7f63c9fba/users/c31fa5e5f30346fbb66edc573f53fa29/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:33.965011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:33.977844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0be8-aca8-4134-bbbe-835645793e59 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:34.041223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb980e6-b1d6-4c37-87d3-d8495a3c1e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:34.041899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb980e6-b1d6-4c37-87d3-d8495a3c1e7d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:34.042183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb980e6-b1d6-4c37-87d3-d8495a3c1e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:34.043318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb980e6-b1d6-4c37-87d3-d8495a3c1e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:34.044453 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb980e6-b1d6-4c37-87d3-d8495a3c1e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:34.046169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb980e6-b1d6-4c37-87d3-d8495a3c1e7d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:34.059240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1091/2182] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:34.063786 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:34.075291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bdd0d-d770-48c3-8a7b-7c18fca24614 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:34.080168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:34.081058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:34.081329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:34.081600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] PATH_INFO: `/v3/projects/17e317e83c004f788d2a0fb7f63c9fba/users/c31fa5e5f30346fbb66edc573f53fa29/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:34.083764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e317e83c004f788d2a0fb7f63c9fba, user_id=c31fa5e5f30346fbb66edc573f53fa29, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:34.086376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:34.096854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1092/2183] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:34 2022] PUT /identity/v3/projects/17e317e83c004f788d2a0fb7f63c9fba/users/c31fa5e5f30346fbb66edc573f53fa29/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:34.107061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab5bac-6921-4bd0-85b6-ef01a1ee45ed None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:34.107357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab5bac-6921-4bd0-85b6-ef01a1ee45ed None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:34.107662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab5bac-6921-4bd0-85b6-ef01a1ee45ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:34.134247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6eab5bac-6921-4bd0-85b6-ef01a1ee45ed None None] MFA Rules not processed for user `c31fa5e5f30346fbb66edc573f53fa29`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:34.135982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6eab5bac-6921-4bd0-85b6-ef01a1ee45ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:34.205159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1092/2184] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:34.215428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:34.217485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:34.282231 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcdb63-4091-4a3d-93f4-9f1b7b754b17 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:34.285945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:34.286595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:34.286919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:34.287188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:34.296990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:34.298424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:34.308269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1093/2185] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:34.543276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab5bac-6921-4bd0-85b6-ef01a1ee45ed None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:34.554433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab5bac-6921-4bd0-85b6-ef01a1ee45ed None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:34.561273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:34.561273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:34.561273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:34.561273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:34.618571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:34.620626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:34.630083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1093/2186] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:35.219630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:35.221358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:35.288292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dc6ce-3e11-4dca-b64c-8f213a281971 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:35.292917 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:35.293780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:35.294057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:35.294329 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] PATH_INFO: `/v3/users/4206483570704442b478d91317d1b491` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:35.295644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4206483570704442b478d91317d1b491)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:35.297556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:35.588597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4206483570704442b478d91317d1b491'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:35.596089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4206483570704442b478d91317d1b491'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:35.730645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4206483570704442b478d91317d1b491'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:35.731440 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4206483570704442b478d91317d1b491'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:35.744234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3e189c23-fbc8-45f1-b955-23ca133a0ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4206483570704442b478d91317d1b491'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:35.750180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1094/2187] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:35 2022] DELETE /identity/v3/users/4206483570704442b478d91317d1b491 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:36.020488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:36.033803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653b606-5215-417d-8927-ee60d8616bb8 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:36.107751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:36.108754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.109048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.109321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] PATH_INFO: `/v3/projects/45cef721011d4bc385f3fed06e492c22` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.110548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cef721011d4bc385f3fed06e492c22)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:36.112498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:36.229124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cef721011d4bc385f3fed06e492c22', 'request_id': 'req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:36.236538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cef721011d4bc385f3fed06e492c22', 'request_id': 'req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:36.335794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cef721011d4bc385f3fed06e492c22', 'request_id': 'req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:36.347041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] The token cache is being invalidate because project 45cef721011d4bc385f3fed06e492c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:36.347328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:36.347954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fc53e0a2-f13a-40d0-9f0d-67a4da4efd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:36.349479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1094/2188] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:36 2022] DELETE /identity/v3/projects/45cef721011d4bc385f3fed06e492c22 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:36.355220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdcb4c-79b3-40a9-a3b4-57e4502a4805 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.355709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdcb4c-79b3-40a9-a3b4-57e4502a4805 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.355813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdcb4c-79b3-40a9-a3b4-57e4502a4805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.373885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-06fdcb4c-79b3-40a9-a3b4-57e4502a4805 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:36.375090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-06fdcb4c-79b3-40a9-a3b4-57e4502a4805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:36.435886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1095/2189] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:36.444310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2aeb-b49d-41ee-a91a-161c46cd511a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.444601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2aeb-b49d-41ee-a91a-161c46cd511a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.444894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2aeb-b49d-41ee-a91a-161c46cd511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.463613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e2fc2aeb-b49d-41ee-a91a-161c46cd511a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:36.464790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e2fc2aeb-b49d-41ee-a91a-161c46cd511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:36.472530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1095/2190] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:36.476521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdcb4c-79b3-40a9-a3b4-57e4502a4805 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:36.486111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdcb4c-79b3-40a9-a3b4-57e4502a4805 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:36.490669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:36.491342 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.491624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.491899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.492629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:36.492934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:36.495342 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:36.511515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1096/2191] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:56:36.514490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2aeb-b49d-41ee-a91a-161c46cd511a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:36.524063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2aeb-b49d-41ee-a91a-161c46cd511a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:36.528809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:36.529460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.529739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.530164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.531038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:36.532914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:36.662967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1096/2192] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:36 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:36.667645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:36.677387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3406202-28e6-4c55-bff2-62c78927bea1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:36.735391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:36.735391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.735391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.735391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.735772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:36.735772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:36.913321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1097/2193] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:36 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:36.917489 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:36.927498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b41d47-cf9d-4258-9310-fdf55c413a10 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:36.932248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:36.933004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.933288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.933559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.934300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:36.936025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:36.947819 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1097/2194] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:36.958401 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:36.969429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ea0a5-349f-4c96-a8ae-5b8f4c45daa9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:36.974099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b3572-2868-45ec-bb1f-f84aa7eac794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:36.975096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3572-2868-45ec-bb1f-f84aa7eac794 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:36.975427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3572-2868-45ec-bb1f-f84aa7eac794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:36.975656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3572-2868-45ec-bb1f-f84aa7eac794 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:36.976402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b3572-2868-45ec-bb1f-f84aa7eac794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:36.978026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b3572-2868-45ec-bb1f-f84aa7eac794 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:36.988360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1098/2195] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:36.992562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:37.003249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406659a3-7a6c-4d2c-b858-b37303fa89e5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:37.007712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:37.008569 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:37.008844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:37.009154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] PATH_INFO: `/v3/projects/4688ab42978643be9b14c64d40460b93/users/d641be97d52d43f1bd5276e18810ffca/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:37.023389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4688ab42978643be9b14c64d40460b93, user_id=d641be97d52d43f1bd5276e18810ffca, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:37.026616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:37.181869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1098/2196] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:36 2022] PUT /identity/v3/projects/4688ab42978643be9b14c64d40460b93/users/d641be97d52d43f1bd5276e18810ffca/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:37.187080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c88b4-7ef3-4c54-9e7f-153cca996541 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:37.187399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c88b4-7ef3-4c54-9e7f-153cca996541 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:37.187681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c88b4-7ef3-4c54-9e7f-153cca996541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:37.205053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-195c88b4-7ef3-4c54-9e7f-153cca996541 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:37.206235 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-195c88b4-7ef3-4c54-9e7f-153cca996541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:37.263940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1099/2197] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:37.273608 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:37.275800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:37.331060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645020f-30e3-4245-a245-cd2381e093b0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:37.334704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:37.335394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:37.335673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:37.335942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:37.345120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:37.346531 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:37.355730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1099/2198] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:38.788326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b682c-3794-45fb-94d3-bab5b4f9802e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:38.789205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b682c-3794-45fb-94d3-bab5b4f9802e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:38.789502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b682c-3794-45fb-94d3-bab5b4f9802e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:38.818554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ff7b682c-3794-45fb-94d3-bab5b4f9802e None None] MFA Rules not processed for user `d641be97d52d43f1bd5276e18810ffca`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:38.819876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ff7b682c-3794-45fb-94d3-bab5b4f9802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:38.889246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1100/2199] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:38.899314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:38.900843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:38.957127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b814e8-d556-4c89-bd7d-b4800c85d2af service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:38.960616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:38.961248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:38.961529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:38.961799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:38.969907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:38.971532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:38.981559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1100/2200] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:41.845743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878da60-426a-4ebc-a725-668170e2dc1b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:41.846274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878da60-426a-4ebc-a725-668170e2dc1b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:41.846274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878da60-426a-4ebc-a725-668170e2dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:41.867751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a878da60-426a-4ebc-a725-668170e2dc1b None None] MFA Rules not processed for user `d641be97d52d43f1bd5276e18810ffca`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:41.869267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a878da60-426a-4ebc-a725-668170e2dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:41.876270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1101/2201] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:42.943693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:42.945165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:42.959443 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fc107-076a-4896-9f52-f402d9a4e777 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:42.964867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:42.965739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:42.966024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:42.966300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] PATH_INFO: `/v3/users/1a9ce4dff1bd4ee59a470e712b235bbc` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:42.967596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9ce4dff1bd4ee59a470e712b235bbc)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:42.969535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:43.259255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9ce4dff1bd4ee59a470e712b235bbc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:43.269384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9ce4dff1bd4ee59a470e712b235bbc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:43.271088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9ce4dff1bd4ee59a470e712b235bbc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:43.387303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9ce4dff1bd4ee59a470e712b235bbc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:43.400000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9ce4dff1bd4ee59a470e712b235bbc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:43.406845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1101/2202] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:42 2022] DELETE /identity/v3/users/1a9ce4dff1bd4ee59a470e712b235bbc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:43.411713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:43.412194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:43.412283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:43.429999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:43.431247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:43.490666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1102/2203] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:43.502273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:43.503955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:43.565362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfb22-fbc7-4d6f-9e96-906b68e6d8f5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:43.569198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:43.569853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:43.570134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:43.570476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:43.587755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:43.589216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:43.603959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1102/2204] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:44.183444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:44.187591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:44.199384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edcd7e-c9d2-456a-a73d-ed7ce23fc46f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:44.205512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:44.206654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:44.207130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:44.207600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] PATH_INFO: `/v3/projects/0a30555c8d0d47eba75893e70dda6d26` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:44.209795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a30555c8d0d47eba75893e70dda6d26)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:44.215182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:44.371248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a30555c8d0d47eba75893e70dda6d26', 'request_id': 'req-7c2324bc-4338-45f6-beaa-2275124de661'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.376655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a30555c8d0d47eba75893e70dda6d26', 'request_id': 'req-7c2324bc-4338-45f6-beaa-2275124de661'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.461568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a30555c8d0d47eba75893e70dda6d26', 'request_id': 'req-7c2324bc-4338-45f6-beaa-2275124de661'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.478694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] The token cache is being invalidate because project 0a30555c8d0d47eba75893e70dda6d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:44.478694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.479046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.480567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1103/2205] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:44 2022] DELETE /identity/v3/projects/0a30555c8d0d47eba75893e70dda6d26 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:44.484595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:44.495980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15d717-1958-4e91-93eb-860ca6ee466d service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:44.551812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:44.552683 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:44.552968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:44.553242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] PATH_INFO: `/v3/users/c31fa5e5f30346fbb66edc573f53fa29` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:44.554460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31fa5e5f30346fbb66edc573f53fa29)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:44.557015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:44.762112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31fa5e5f30346fbb66edc573f53fa29'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.778458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31fa5e5f30346fbb66edc573f53fa29'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.779212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31fa5e5f30346fbb66edc573f53fa29'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.844282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31fa5e5f30346fbb66edc573f53fa29'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.856561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-3b279929-a42e-405a-98e8-53defc614e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31fa5e5f30346fbb66edc573f53fa29'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:44.865949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1103/2206] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:44 2022] DELETE /identity/v3/users/c31fa5e5f30346fbb66edc573f53fa29 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:45.486202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:45.489012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:45.503350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2324bc-4338-45f6-beaa-2275124de661 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:45.619344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:45.620476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:45.622107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:45.622412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] PATH_INFO: `/v3/projects/17e317e83c004f788d2a0fb7f63c9fba` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:45.623708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e317e83c004f788d2a0fb7f63c9fba)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:45.625634 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:45.736109 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e317e83c004f788d2a0fb7f63c9fba', 'request_id': 'req-56174b1c-f529-4ee8-a20d-89f627892d47'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:45.741494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e317e83c004f788d2a0fb7f63c9fba', 'request_id': 'req-56174b1c-f529-4ee8-a20d-89f627892d47'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:45.929444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e317e83c004f788d2a0fb7f63c9fba', 'request_id': 'req-56174b1c-f529-4ee8-a20d-89f627892d47'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:45.942423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] The token cache is being invalidate because project 17e317e83c004f788d2a0fb7f63c9fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:45.942957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:45.943642 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-56174b1c-f529-4ee8-a20d-89f627892d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:45.945233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1104/2207] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:45 2022] DELETE /identity/v3/projects/17e317e83c004f788d2a0fb7f63c9fba => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:45.951031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48499f-a688-4e9f-9d43-c376da72c27f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:45.951511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48499f-a688-4e9f-9d43-c376da72c27f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:45.951745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48499f-a688-4e9f-9d43-c376da72c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:45.971048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5a48499f-a688-4e9f-9d43-c376da72c27f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:45.972365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5a48499f-a688-4e9f-9d43-c376da72c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:46.039500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1104/2208] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:46.049056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a26c4-e69d-4266-b96d-b45af6b06f16 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.049348 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a26c4-e69d-4266-b96d-b45af6b06f16 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.049653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a26c4-e69d-4266-b96d-b45af6b06f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.072011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e81a26c4-e69d-4266-b96d-b45af6b06f16 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:46.073793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e81a26c4-e69d-4266-b96d-b45af6b06f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:46.089195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1105/2209] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:46.093186 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48499f-a688-4e9f-9d43-c376da72c27f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:46.106146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48499f-a688-4e9f-9d43-c376da72c27f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:46.109603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:46.110277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.110561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.110955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.111619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:46.111929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:46.113593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:46.132201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1105/2210] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:56:46.136254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a26c4-e69d-4266-b96d-b45af6b06f16 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:46.146421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a26c4-e69d-4266-b96d-b45af6b06f16 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:46.151896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:46.156010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.156010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.156010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.156010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:46.156481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:46.285999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1106/2211] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:46 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:46.298302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:46.309265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a80bc-6bd7-4bc7-9ddb-65dd69b3a830 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:46.372846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:46.373554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.373817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.374358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.375145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:46.377296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:46.468581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1106/2212] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:46 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:46.471036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:46.486244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f687ee7-4044-4699-80c4-be20c254296f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:46.502275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:46.503269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.503729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.504054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.504806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:46.507409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:46.520699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1107/2213] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:46.525406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:46.535682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b9b79-b821-4f6b-99a9-70cb85cf68af admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:46.543949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f7b2a-d2f9-4b8a-9b9d-3d9db00b9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:46.544327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7b2a-d2f9-4b8a-9b9d-3d9db00b9eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.544689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7b2a-d2f9-4b8a-9b9d-3d9db00b9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.544886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7b2a-d2f9-4b8a-9b9d-3d9db00b9eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.545872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f7b2a-d2f9-4b8a-9b9d-3d9db00b9eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:46.547843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f7b2a-d2f9-4b8a-9b9d-3d9db00b9eb7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:46.563136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1107/2214] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:46.566968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:46.583297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282a45-a55c-4797-86c0-8abf20f0a630 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:46.588862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:46.589823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.590286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.590717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] PATH_INFO: `/v3/projects/84ffc4b348bb4df5b9b4d4e9a514e10a/users/c4a75f7fc93b44e0bc2743f6b8973e64/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.608731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ffc4b348bb4df5b9b4d4e9a514e10a, user_id=c4a75f7fc93b44e0bc2743f6b8973e64, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:46.611434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:46.691185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1108/2215] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:46 2022] PUT /identity/v3/projects/84ffc4b348bb4df5b9b4d4e9a514e10a/users/c4a75f7fc93b44e0bc2743f6b8973e64/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:46.702617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e4d5-a53a-4e2d-874e-5cecfad32854 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.702934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e4d5-a53a-4e2d-874e-5cecfad32854 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.703207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e4d5-a53a-4e2d-874e-5cecfad32854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.732412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-cc31e4d5-a53a-4e2d-874e-5cecfad32854 None None] MFA Rules not processed for user `c4a75f7fc93b44e0bc2743f6b8973e64`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:46.734036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cc31e4d5-a53a-4e2d-874e-5cecfad32854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:46.799527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1108/2216] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:46.803910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:46.866676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9aae0-478c-4b41-88f3-eb3c5f014ef5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:46.872203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:46.872862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:46.873143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:46.873416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:46.875271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:46.876467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:47.051333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1109/2217] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:46 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:47.055375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e4d5-a53a-4e2d-874e-5cecfad32854 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:47.067550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e4d5-a53a-4e2d-874e-5cecfad32854 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:47.128459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:47.129136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:47.129420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:47.129699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:47.130420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:47.132363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:47.384914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1109/2218] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:47 2022] POST /identity/v3/users => generated 299 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:47.390186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:47.401532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723010-877f-4c61-b654-3696641c0b9a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:47.406572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:47.407288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:47.407572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:47.407912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:47.408781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:47.410489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:47.425020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1110/2219] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:47.426453 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:47.437707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f31fb-87b5-43ad-9595-5a5862475519 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:47.443606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:47.444511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:47.444784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:47.445062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] PATH_INFO: `/v3/projects/7229f1eae5ef4c6c8b89c7133750a667/users/be870cd19d804ff2a42224369cbd6529/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:47.467216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7229f1eae5ef4c6c8b89c7133750a667, user_id=be870cd19d804ff2a42224369cbd6529, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:47.471202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:47.702809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1110/2220] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:47 2022] PUT /identity/v3/projects/7229f1eae5ef4c6c8b89c7133750a667/users/be870cd19d804ff2a42224369cbd6529/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:47.706523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:47.722805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c17e-dbc7-4cb9-8c2e-be248359c0d9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:47.781361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cba9-6110-4ee9-8b43-ad14c8a3082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:47.782028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cba9-6110-4ee9-8b43-ad14c8a3082f admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:47.782308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cba9-6110-4ee9-8b43-ad14c8a3082f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:47.782585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cba9-6110-4ee9-8b43-ad14c8a3082f admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:47.783354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cba9-6110-4ee9-8b43-ad14c8a3082f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:47.784972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cba9-6110-4ee9-8b43-ad14c8a3082f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:47.795214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1111/2221] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:47.799490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:47.810357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a622bf-b425-4f60-a8a1-703e9720cd7a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:47.815158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:47.816128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:47.816408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:47.816681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] PATH_INFO: `/v3/projects/7229f1eae5ef4c6c8b89c7133750a667/users/be870cd19d804ff2a42224369cbd6529/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:47.818680 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7229f1eae5ef4c6c8b89c7133750a667, user_id=be870cd19d804ff2a42224369cbd6529, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:47.821404 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:47.832005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1111/2222] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:47 2022] PUT /identity/v3/projects/7229f1eae5ef4c6c8b89c7133750a667/users/be870cd19d804ff2a42224369cbd6529/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:47.850705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:47.850705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:47.850705 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:47.876649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] MFA Rules not processed for user `be870cd19d804ff2a42224369cbd6529`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:47.878002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:47.931060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:47.933547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:47.960767 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1112/2223] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:47.971097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:47.972472 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:48.007307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262275-cf57-4057-9a34-7a5bb46bcb44 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:48.022353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:48.023273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:48.023556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:48.023833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] PATH_INFO: `/v3/users/8590cb39fdcb499ab21077e47371822e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:48.025307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8590cb39fdcb499ab21077e47371822e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:48.027340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:48.083259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab3bbb-6875-4358-9e37-8d4003f56085 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:48.087304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:48.088155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:48.088506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:48.088878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:48.098817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:48.105008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:48.111520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1113/2224] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:48.268215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8590cb39fdcb499ab21077e47371822e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:48.275803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8590cb39fdcb499ab21077e47371822e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:48.277553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8590cb39fdcb499ab21077e47371822e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:48.352771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8590cb39fdcb499ab21077e47371822e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:48.373568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-64d981bb-033b-4869-9be8-2d925159c102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8590cb39fdcb499ab21077e47371822e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:48.380072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1112/2225] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:47 2022] DELETE /identity/v3/users/8590cb39fdcb499ab21077e47371822e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:48.730124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:48.745825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f1e17-98ac-40b7-a2cb-08cbc07a657f service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:48.839463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:48.840330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:48.840609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:48.840883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] PATH_INFO: `/v3/projects/9cb309ded717452cace3567dacc87b2f` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:48.842127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb309ded717452cace3567dacc87b2f)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:48.844083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:48.974884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb309ded717452cace3567dacc87b2f', 'request_id': 'req-3f994277-5baa-438f-851e-7d02ba57fd37'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:48.980606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb309ded717452cace3567dacc87b2f', 'request_id': 'req-3f994277-5baa-438f-851e-7d02ba57fd37'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.089222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb309ded717452cace3567dacc87b2f', 'request_id': 'req-3f994277-5baa-438f-851e-7d02ba57fd37'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.113572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] The token cache is being invalidate because project 9cb309ded717452cace3567dacc87b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:49.113572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.113572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3f994277-5baa-438f-851e-7d02ba57fd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.113572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1114/2226] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:48 2022] DELETE /identity/v3/projects/9cb309ded717452cace3567dacc87b2f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:49.115274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5d01-9f3e-4076-8764-5656d4b2df6a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.115567 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5d01-9f3e-4076-8764-5656d4b2df6a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.115843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5d01-9f3e-4076-8764-5656d4b2df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.137876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-343e5d01-9f3e-4076-8764-5656d4b2df6a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:49.139043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-343e5d01-9f3e-4076-8764-5656d4b2df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:49.200175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1113/2227] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:49.208241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f34f8-3bb9-418c-88a8-c705ec3fadc7 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.208647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f34f8-3bb9-418c-88a8-c705ec3fadc7 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.209013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f34f8-3bb9-418c-88a8-c705ec3fadc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.229250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-826f34f8-3bb9-418c-88a8-c705ec3fadc7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:49.231014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-826f34f8-3bb9-418c-88a8-c705ec3fadc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:49.240485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1115/2228] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:49.246446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5d01-9f3e-4076-8764-5656d4b2df6a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.256557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5d01-9f3e-4076-8764-5656d4b2df6a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:49.262224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:49.262941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.267151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.267461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.273286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:49.273286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:49.273286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:49.283790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1114/2229] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:56:49.288227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f34f8-3bb9-418c-88a8-c705ec3fadc7 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.301119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f34f8-3bb9-418c-88a8-c705ec3fadc7 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:49.303644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:49.304302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.304612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.304889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.305733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:49.307718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:49.434812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1116/2230] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:49 2022] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:49.438482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.448529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a149765-e188-47d9-88de-2e4b8875b3fc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:49.488771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.490459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:49.508430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:49.508786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.509070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.509350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.510068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:49.512052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:49.572704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454277dd-3d3c-4183-b35b-f50e89212bc9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:49.577912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:49.578816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.579099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.579374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] PATH_INFO: `/v3/users/c4a75f7fc93b44e0bc2743f6b8973e64` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.580643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a75f7fc93b44e0bc2743f6b8973e64)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:49.582571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:49.628767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1115/2231] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:49 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:49.632589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.642909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585431f-9ee3-4e12-b1ea-14bdd0aa8f7a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:49.647934 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:49.648674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.649021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.649419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.650154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:49.651781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:49.661968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1116/2232] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:49.666464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.676953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ae21-b217-4642-bf90-27f6d4eb2cbd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:49.682099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:49.682799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.683079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.683346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.684071 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:49.685700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:49.696421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1117/2233] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:49.700288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.709675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323a52c-b27c-41dd-b56b-fcc8abf5b1b6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:49.714426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5652-9c81-456a-b6fd-f471791187c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:49.715395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5652-9c81-456a-b6fd-f471791187c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.715668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5652-9c81-456a-b6fd-f471791187c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.715948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5652-9c81-456a-b6fd-f471791187c4 admin admin] PATH_INFO: `/v3/projects/d2d2e0f9f7be4cc18e40a40da5cc0057/users/032bbbd7c5f347b0b628535fb9afdaee/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.730922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5652-9c81-456a-b6fd-f471791187c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d2e0f9f7be4cc18e40a40da5cc0057, user_id=032bbbd7c5f347b0b628535fb9afdaee, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:49.733861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5652-9c81-456a-b6fd-f471791187c4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:49.772420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a75f7fc93b44e0bc2743f6b8973e64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.780217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a75f7fc93b44e0bc2743f6b8973e64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.878924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1118/2234] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:49 2022] PUT /identity/v3/projects/d2d2e0f9f7be4cc18e40a40da5cc0057/users/032bbbd7c5f347b0b628535fb9afdaee/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:49.889961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.890247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.890524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.918364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] MFA Rules not processed for user `032bbbd7c5f347b0b628535fb9afdaee`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:49.919740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:49.930999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a75f7fc93b44e0bc2743f6b8973e64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.931732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a75f7fc93b44e0bc2743f6b8973e64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.953046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c3b6abac-e893-4a12-88ed-11451b529c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a75f7fc93b44e0bc2743f6b8973e64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:49.971926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1117/2235] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:49 2022] DELETE /identity/v3/users/c4a75f7fc93b44e0bc2743f6b8973e64 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:49.976190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:49.976482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:49.976765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:49.989850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1119/2236] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:49.995285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:49.995444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:49.996763 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:49.996889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:50.066512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1118/2237] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:50.075997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.080104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:50.090146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9db20-3d47-403d-a508-b16e47fcd2b8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.095494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.096101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.096388 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.096667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.097379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.099387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.139698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85096c93-db79-4538-a882-1c7e1c0347c3 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.143586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.144298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.144585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.144857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.155593 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.157176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.168147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1119/2238] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:50.208530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1120/2239] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:49 2022] POST /identity/v3/projects => generated 403 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:50.209815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.220179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a11e5-fcab-4e21-8961-a49d8058c4a4 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.287188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.287891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.288170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.288444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.289145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.291190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.401581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1120/2240] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:50 2022] POST /identity/v3/users => generated 308 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:50.404843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.417001 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814c3e-3384-4882-b3a4-84dd92df3fa7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.427762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.428490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.428777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.429053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.430393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.432806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.445199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1121/2241] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:50.450147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.460709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290d5a-3d5e-41e8-816c-7d9c4f840903 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.466267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.469357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.469357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.469357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] PATH_INFO: `/v3/projects/645093ee54234fae98d02782e77aae3e/users/37d9c02795254b54b911a12d9962e8eb/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.484635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] RBAC: Authorizing `identity:create_grant(project_id=645093ee54234fae98d02782e77aae3e, user_id=37d9c02795254b54b911a12d9962e8eb, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.487511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.581168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1121/2242] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:50 2022] PUT /identity/v3/projects/645093ee54234fae98d02782e77aae3e/users/37d9c02795254b54b911a12d9962e8eb/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:50.585085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.595456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f712f6-d0a6-4139-bc69-f9906c07b360 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.649860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.650516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.650835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.651135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.651877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.653541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.657863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.659677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:50.665482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1122/2243] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:50.670096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.674646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb508b4-a56e-4a98-bc6c-4da4747b784a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.679524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.680403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.680699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250d60-e046-4ed8-97a1-7a295c69228b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.680814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.680969 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] PATH_INFO: `/v3/projects/84ffc4b348bb4df5b9b4d4e9a514e10a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.682149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ffc4b348bb4df5b9b4d4e9a514e10a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.692227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.692640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab0e8-a022-41cb-8d15-79ed08f91557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.692640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab0e8-a022-41cb-8d15-79ed08f91557 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.692640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab0e8-a022-41cb-8d15-79ed08f91557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.692640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab0e8-a022-41cb-8d15-79ed08f91557 admin admin] PATH_INFO: `/v3/projects/645093ee54234fae98d02782e77aae3e/users/37d9c02795254b54b911a12d9962e8eb/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.693167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ab0e8-a022-41cb-8d15-79ed08f91557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645093ee54234fae98d02782e77aae3e, user_id=37d9c02795254b54b911a12d9962e8eb, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.693167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ab0e8-a022-41cb-8d15-79ed08f91557 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.702403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1123/2244] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:50 2022] PUT /identity/v3/projects/645093ee54234fae98d02782e77aae3e/users/37d9c02795254b54b911a12d9962e8eb/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:50.712666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.712885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.713165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.738836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] MFA Rules not processed for user `37d9c02795254b54b911a12d9962e8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:50.740052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:50.806817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1124/2245] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:50.816099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.817387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:50.843976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ffc4b348bb4df5b9b4d4e9a514e10a', 'request_id': 'req-3107d5be-c66a-4b7f-b005-f9b5baff0748'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:50.849293 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ffc4b348bb4df5b9b4d4e9a514e10a', 'request_id': 'req-3107d5be-c66a-4b7f-b005-f9b5baff0748'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:50.874254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f5b7a-1f85-4699-bbfa-2d867729f779 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:50.921313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:50.921959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:50.922248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:50.922538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:50.935619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ffc4b348bb4df5b9b4d4e9a514e10a', 'request_id': 'req-3107d5be-c66a-4b7f-b005-f9b5baff0748'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:50.949119 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] The token cache is being invalidate because project 84ffc4b348bb4df5b9b4d4e9a514e10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:50.949448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:50.950117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:50.951784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1122/2246] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:50 2022] DELETE /identity/v3/projects/84ffc4b348bb4df5b9b4d4e9a514e10a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:50.955550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:50.956841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:50.983151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:50.984520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:50.995015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1125/2247] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:51.019465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107d5be-c66a-4b7f-b005-f9b5baff0748 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:51.025048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:51.025880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:51.026178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:51.026452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] PATH_INFO: `/v3/users/be870cd19d804ff2a42224369cbd6529` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:51.027716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be870cd19d804ff2a42224369cbd6529)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:51.029672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:51.124292 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:51.134601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a435-1ca1-4b52-8f90-3f1ecf62137f service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:51.139118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:51.139969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:51.140246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:51.140545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] PATH_INFO: `/v3/users/032bbbd7c5f347b0b628535fb9afdaee` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:51.141750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=032bbbd7c5f347b0b628535fb9afdaee)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:51.143692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:51.383229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be870cd19d804ff2a42224369cbd6529'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.390126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be870cd19d804ff2a42224369cbd6529'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.417373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032bbbd7c5f347b0b628535fb9afdaee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.424234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032bbbd7c5f347b0b628535fb9afdaee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.424903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032bbbd7c5f347b0b628535fb9afdaee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.477291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be870cd19d804ff2a42224369cbd6529'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.477904 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be870cd19d804ff2a42224369cbd6529'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.489885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3af5279f-1cba-42ae-9944-aa22e09ef31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be870cd19d804ff2a42224369cbd6529'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.495965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1123/2248] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:50 2022] DELETE /identity/v3/users/be870cd19d804ff2a42224369cbd6529 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:51.558117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032bbbd7c5f347b0b628535fb9afdaee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.574061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032bbbd7c5f347b0b628535fb9afdaee'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:51.580301 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1126/2249] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:51 2022] DELETE /identity/v3/users/032bbbd7c5f347b0b628535fb9afdaee => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:51.584747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:51.585037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:51.585318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:51.603079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:51.604315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:51.663273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1124/2250] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:51.673466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:51.674938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:51.741829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2278c-88d1-4e38-ab43-b68db73a8c8a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:51.749220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a3bc5-822d-4d6a-b480-44ddfb570846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:51.749882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3bc5-822d-4d6a-b480-44ddfb570846 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:51.750162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3bc5-822d-4d6a-b480-44ddfb570846 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:51.750435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3bc5-822d-4d6a-b480-44ddfb570846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:51.760966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a3bc5-822d-4d6a-b480-44ddfb570846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:51.762402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a3bc5-822d-4d6a-b480-44ddfb570846 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:51.772371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1127/2251] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:51.976214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:51.977711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:51.997299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc783-d9d8-4bc2-acc0-f99af03d95b5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.004337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.004337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.004337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.004337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] PATH_INFO: `/v3/projects/7229f1eae5ef4c6c8b89c7133750a667` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.005228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7229f1eae5ef4c6c8b89c7133750a667)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.006656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.109012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7229f1eae5ef4c6c8b89c7133750a667', 'request_id': 'req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.114517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7229f1eae5ef4c6c8b89c7133750a667', 'request_id': 'req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.203764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7229f1eae5ef4c6c8b89c7133750a667', 'request_id': 'req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.215967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] The token cache is being invalidate because project 7229f1eae5ef4c6c8b89c7133750a667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:52.216254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.216906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.218676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1125/2252] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:51 2022] DELETE /identity/v3/projects/7229f1eae5ef4c6c8b89c7133750a667 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:52.224057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c148b-d23c-41a7-964b-9ae121b4f793 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.224349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c148b-d23c-41a7-964b-9ae121b4f793 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.224634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c148b-d23c-41a7-964b-9ae121b4f793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.243941 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-969c148b-d23c-41a7-964b-9ae121b4f793 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:52.245215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-969c148b-d23c-41a7-964b-9ae121b4f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:52.286838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.288905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:52.313855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1128/2253] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:52.325433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47acb2-9cfc-429b-aad6-9d3b733828f3 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.325951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47acb2-9cfc-429b-aad6-9d3b733828f3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.326532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47acb2-9cfc-429b-aad6-9d3b733828f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.349029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6e47acb2-9cfc-429b-aad6-9d3b733828f3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:52.351697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6e47acb2-9cfc-429b-aad6-9d3b733828f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:52.369355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1129/2254] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:52.374385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47acb2-9cfc-429b-aad6-9d3b733828f3 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.390237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47acb2-9cfc-429b-aad6-9d3b733828f3 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.395203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ebc0-e598-437d-8b17-dc1fc3af012a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.396134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.396960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.397248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.397540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.398275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:52.398575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.400813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.400962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.401922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.402271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.402884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] PATH_INFO: `/v3/projects/d2d2e0f9f7be4cc18e40a40da5cc0057` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.404157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d2e0f9f7be4cc18e40a40da5cc0057)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.406425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.420803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1130/2255] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:56:52.421630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.444812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a9330-5530-4adc-b01a-a790b1329ebd admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.451708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.452417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.452727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.453261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.454206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.456240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.575338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d2e0f9f7be4cc18e40a40da5cc0057', 'request_id': 'req-8d0ae2fb-89cb-4972-8ffd-9034f155620b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.580998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d2e0f9f7be4cc18e40a40da5cc0057', 'request_id': 'req-8d0ae2fb-89cb-4972-8ffd-9034f155620b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.605274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1131/2256] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:52 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:52.609454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.672368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d6df4-d305-43aa-8fd1-d31c3d2d227d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.677011 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.677668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.677948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.685352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.685352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.685352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.706826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d2e0f9f7be4cc18e40a40da5cc0057', 'request_id': 'req-8d0ae2fb-89cb-4972-8ffd-9034f155620b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.718942 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] The token cache is being invalidate because project d2d2e0f9f7be4cc18e40a40da5cc0057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:52.719230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.719893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:52.721574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1126/2257] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:52 2022] DELETE /identity/v3/projects/d2d2e0f9f7be4cc18e40a40da5cc0057 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:52.725405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.726856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:52.811744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ae2fb-89cb-4972-8ffd-9034f155620b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.824043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1132/2258] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:52 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:52.827016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.828495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.831421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:52.833113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.836230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.836733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] PATH_INFO: `/v3/users/37d9c02795254b54b911a12d9962e8eb` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.841319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d9c02795254b54b911a12d9962e8eb)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.845360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.855979 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb402e6-a6ce-4cb3-8b80-bbe8a329ca7d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.879371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.880571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.880890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.881907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.882527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.885381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.902028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1133/2259] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:52.903278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.914254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df53f1-725b-4bae-bdd9-2cfca0049ced admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.920147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.920873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.921338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.921649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.922410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.924057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:52.949281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1134/2260] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:52.953391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:52.965171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01192752-da6e-4dc5-aa45-63324475bb90 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:52.970392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884e47-3004-498b-9699-e8e8efaf9f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:52.972004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884e47-3004-498b-9699-e8e8efaf9f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:52.972323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884e47-3004-498b-9699-e8e8efaf9f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:52.972610 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884e47-3004-498b-9699-e8e8efaf9f84 admin admin] PATH_INFO: `/v3/projects/c2578c6c29704129aaeed6d0223d983d/users/dcef6161fa364e979a22ede2ba488690/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:52.989904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884e47-3004-498b-9699-e8e8efaf9f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2578c6c29704129aaeed6d0223d983d, user_id=dcef6161fa364e979a22ede2ba488690, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:52.992619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884e47-3004-498b-9699-e8e8efaf9f84 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:53.070929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1135/2261] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:52 2022] PUT /identity/v3/projects/c2578c6c29704129aaeed6d0223d983d/users/dcef6161fa364e979a22ede2ba488690/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:53.077804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d9c02795254b54b911a12d9962e8eb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.081998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:53.082288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:53.082642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:53.085481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d9c02795254b54b911a12d9962e8eb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.110307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] MFA Rules not processed for user `dcef6161fa364e979a22ede2ba488690`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:53.111577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:53.180147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1136/2262] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:53.189840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:53.191193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:53.209800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d9c02795254b54b911a12d9962e8eb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.210758 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d9c02795254b54b911a12d9962e8eb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.224603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d9c02795254b54b911a12d9962e8eb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.231251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1127/2263] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:52 2022] DELETE /identity/v3/users/37d9c02795254b54b911a12d9962e8eb => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:53.248104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d7148-88fa-4f95-9654-a1dbe2ef6761 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:53.303515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:53.304167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:53.304450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:53.304717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:53.310310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:53.372587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:53.373521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:53.382785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1137/2264] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:53.403064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:53.404471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:53.479820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d199-75fc-454d-a23b-542e5adc4a3b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:53.484965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:53.485842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:53.486146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:53.486422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] PATH_INFO: `/v3/users/dcef6161fa364e979a22ede2ba488690` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:53.487694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcef6161fa364e979a22ede2ba488690)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:53.489630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:53.748578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:53.753346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:53.764479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb104c9-3b22-4110-a6e7-241c8fa476c5 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:53.769132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:53.770023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:53.770340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:53.770582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] PATH_INFO: `/v3/projects/645093ee54234fae98d02782e77aae3e` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:53.771929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645093ee54234fae98d02782e77aae3e)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:53.773697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:53.793828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcef6161fa364e979a22ede2ba488690'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.800753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcef6161fa364e979a22ede2ba488690'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.906878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcef6161fa364e979a22ede2ba488690'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.907532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcef6161fa364e979a22ede2ba488690'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.922387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ba8d2fc5-35aa-4398-a35e-acf3c221e2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcef6161fa364e979a22ede2ba488690'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.928716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1128/2265] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:56:53 2022] DELETE /identity/v3/users/dcef6161fa364e979a22ede2ba488690 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:53.929366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645093ee54234fae98d02782e77aae3e', 'request_id': 'req-5c820af3-3a0f-4de9-845b-98c523f8cde4'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.933363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:53.933363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:53.933610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:53.935329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645093ee54234fae98d02782e77aae3e', 'request_id': 'req-5c820af3-3a0f-4de9-845b-98c523f8cde4'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:53.956800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:53.958226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.009946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645093ee54234fae98d02782e77aae3e', 'request_id': 'req-5c820af3-3a0f-4de9-845b-98c523f8cde4'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.016197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1129/2266] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:54.027076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.029090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.029757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] The token cache is being invalidate because project 645093ee54234fae98d02782e77aae3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:54.030058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.030711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5c820af3-3a0f-4de9-845b-98c523f8cde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.032368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1138/2267] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:53 2022] DELETE /identity/v3/projects/645093ee54234fae98d02782e77aae3e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:54.037938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8e57-fa13-4dea-8f69-286857f45180 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.038202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8e57-fa13-4dea-8f69-286857f45180 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.040343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8e57-fa13-4dea-8f69-286857f45180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.062513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-08bb8e57-fa13-4dea-8f69-286857f45180 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:54.063791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-08bb8e57-fa13-4dea-8f69-286857f45180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.073154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1139/2268] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:54.081987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5abc3a-2756-42f9-9aef-a9f3476c8d51 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.082365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5abc3a-2756-42f9-9aef-a9f3476c8d51 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.082642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5abc3a-2756-42f9-9aef-a9f3476c8d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.101744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15b95-819c-4daf-9316-a0e4d6987dbf None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.103062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-bd5abc3a-2756-42f9-9aef-a9f3476c8d51 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:54.104386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bd5abc3a-2756-42f9-9aef-a9f3476c8d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.106256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.107071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.107523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.107797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.109853 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.115167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1140/2269] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:56:54.116980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5abc3a-2756-42f9-9aef-a9f3476c8d51 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.131104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.131104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.131791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5abc3a-2756-42f9-9aef-a9f3476c8d51 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.136383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1130/2270] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:56:54.138105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.138865 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.139152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.139426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.140173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:54.140485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.142107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.157448 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1141/2271] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:56:54.164227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.174020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000a420-a351-4f90-90eb-c9436c64781e service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.179183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.179838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.180116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.181033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.181739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.183951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.298535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1131/2272] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:54.302065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.312303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355195-d638-415e-bd50-834bd23408b8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.378584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.379397 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.380089 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.383000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.385097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.387316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.518685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1142/2273] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:56:54.525562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.535703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c783c5-0f31-4b8d-9d33-08547340846b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.541228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.541889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.542172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.542445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.543224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.544812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.557384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1132/2274] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:54.560787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.570711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2bda-8fec-40cb-bf61-bb2fee2f5978 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.575385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.576034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.576312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.576580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.577305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.578888 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.588918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1143/2275] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:54.593394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.595312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.597267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.604309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea84df-f1af-46d2-9079-91e390c0f49b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.610080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0a661-6356-449a-a6d9-19639baf9cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.611241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0a661-6356-449a-a6d9-19639baf9cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.611518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0a661-6356-449a-a6d9-19639baf9cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.611787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0a661-6356-449a-a6d9-19639baf9cc9 admin admin] PATH_INFO: `/v3/projects/a6b74107ca0a40f78efe94f805b73451/users/ac13fc490b7b46e693e0ba8e297d5d67/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.612207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d62fe3-1a97-49ea-bd2c-088eee585249 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.617066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.618763 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.626260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.626260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] PATH_INFO: `/v3/projects/c2578c6c29704129aaeed6d0223d983d` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.626260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2578c6c29704129aaeed6d0223d983d)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.626260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.637587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0a661-6356-449a-a6d9-19639baf9cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b74107ca0a40f78efe94f805b73451, user_id=ac13fc490b7b46e693e0ba8e297d5d67, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.640310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0a661-6356-449a-a6d9-19639baf9cc9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.717808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1133/2276] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:54 2022] PUT /identity/v3/projects/a6b74107ca0a40f78efe94f805b73451/users/ac13fc490b7b46e693e0ba8e297d5d67/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:54.724481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f3ea-de63-4640-8f71-8d408179c164 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.724770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f3ea-de63-4640-8f71-8d408179c164 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.725050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f3ea-de63-4640-8f71-8d408179c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.755203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-27a9f3ea-de63-4640-8f71-8d408179c164 None None] MFA Rules not processed for user `ac13fc490b7b46e693e0ba8e297d5d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:54.756381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-27a9f3ea-de63-4640-8f71-8d408179c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.757744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2578c6c29704129aaeed6d0223d983d', 'request_id': 'req-a78c6153-c5df-465a-9b0d-149cc1a02835'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.764199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2578c6c29704129aaeed6d0223d983d', 'request_id': 'req-a78c6153-c5df-465a-9b0d-149cc1a02835'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.820377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1134/2277] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:54.825510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f3ea-de63-4640-8f71-8d408179c164 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.872931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2578c6c29704129aaeed6d0223d983d', 'request_id': 'req-a78c6153-c5df-465a-9b0d-149cc1a02835'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.886365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] The token cache is being invalidate because project c2578c6c29704129aaeed6d0223d983d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:56:54.886653 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.887470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-a78c6153-c5df-465a-9b0d-149cc1a02835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:56:54.889143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1144/2278] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:56:54 2022] DELETE /identity/v3/projects/c2578c6c29704129aaeed6d0223d983d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:56:54.893770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f3ea-de63-4640-8f71-8d408179c164 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.894933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f43393-c020-4d83-8fef-8dc72533d49c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.895224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f43393-c020-4d83-8fef-8dc72533d49c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.895500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f43393-c020-4d83-8fef-8dc72533d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.901036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.901949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.902457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.902650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.903454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.906533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.914073 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f9f43393-c020-4d83-8fef-8dc72533d49c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:54.915876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f9f43393-c020-4d83-8fef-8dc72533d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.925511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1145/2279] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:54.936170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453929b-8a73-4efd-9184-14be269f9873 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.936462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453929b-8a73-4efd-9184-14be269f9873 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.936740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453929b-8a73-4efd-9184-14be269f9873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.954951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f453929b-8a73-4efd-9184-14be269f9873 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:54.956204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f453929b-8a73-4efd-9184-14be269f9873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:54.964685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1146/2280] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:54.968886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453929b-8a73-4efd-9184-14be269f9873 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:54.978350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453929b-8a73-4efd-9184-14be269f9873 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:54.982965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:54.983594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:54.983876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:54.984153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:54.984890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:56:54.985226 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:54.986841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:54.998282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1147/2281] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:56:55.002551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.011847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb834e4-ea62-41c7-abcd-d9e70d7eee56 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.016408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.017015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.017297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.017595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.018279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.020236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.081531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1135/2282] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:54 2022] POST /identity/v3/projects => generated 393 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:55.085398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.087778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:55.150972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042d81-d618-4874-ad98-2ab3c500906f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.155679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.156340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.156647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.156909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.157582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.159561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.197289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1148/2283] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:56:55 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:55.198666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.261188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dff68-b0dd-406e-9e4c-c8dc036af40e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.266134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.266837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.267121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.273031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.273031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.273031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.301999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1136/2284] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:55 2022] POST /identity/v3/users => generated 303 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:55.305551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.315435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221cc01-b963-444d-b88a-bbbf5810eb68 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.320103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.320749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.321031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.321810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.322646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.324282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.334062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1137/2285] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:55.338588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.348455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097787-e2c5-4b03-8892-72e2105beee1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.353139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.353988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.354269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.354543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] PATH_INFO: `/v3/projects/2882b75beb1d4ed286184be2d8237bca/users/ee273d2386d44def91829a54fd075f6e/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.369321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2882b75beb1d4ed286184be2d8237bca, user_id=ee273d2386d44def91829a54fd075f6e, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.375063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.375746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1149/2286] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:56:55 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:56:55.379835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.389860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959fef5-d06d-4128-b63b-f8c5ecd06882 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.394382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.395053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.395328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.395601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.396325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.402002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.407989 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1150/2287] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:55.411657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.420703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0869c68-d643-4186-a76b-24ce325c07d8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.426393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.427066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.430981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.430981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.430981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.430981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.440163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1151/2288] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:56:55.444248 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.453493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e812-d85e-472f-931d-43addbe3fbbb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.456728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1138/2289] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:55 2022] PUT /identity/v3/projects/2882b75beb1d4ed286184be2d8237bca/users/ee273d2386d44def91829a54fd075f6e/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:55.461380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.518859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744a48f-1bd9-47b4-a70e-6c9102d77ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.520006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744a48f-1bd9-47b4-a70e-6c9102d77ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.520296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744a48f-1bd9-47b4-a70e-6c9102d77ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.520604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744a48f-1bd9-47b4-a70e-6c9102d77ea9 admin admin] PATH_INFO: `/v3/projects/be3e9354ba4e4d4bb5f55aa03c9985c5/users/192826b3ff234501aec7beeed935ab18/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.524706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e4dd-7d5d-482a-92ff-5612bca42476 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.529880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.530371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.530650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.530953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.531691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.533267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.538689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744a48f-1bd9-47b4-a70e-6c9102d77ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3e9354ba4e4d4bb5f55aa03c9985c5, user_id=192826b3ff234501aec7beeed935ab18, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.541958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744a48f-1bd9-47b4-a70e-6c9102d77ea9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.544336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1139/2290] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:56:55.548759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.558501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e04d0d-8acf-4dd5-863f-670a25b1492a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.563035 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1480bb8-24ab-4cbb-b367-85018febf485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.563884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1480bb8-24ab-4cbb-b367-85018febf485 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.564153 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1480bb8-24ab-4cbb-b367-85018febf485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.564418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1480bb8-24ab-4cbb-b367-85018febf485 admin admin] PATH_INFO: `/v3/projects/2882b75beb1d4ed286184be2d8237bca/users/ee273d2386d44def91829a54fd075f6e/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.566382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1480bb8-24ab-4cbb-b367-85018febf485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2882b75beb1d4ed286184be2d8237bca, user_id=ee273d2386d44def91829a54fd075f6e, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.569069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1480bb8-24ab-4cbb-b367-85018febf485 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.578864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1140/2291] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:55 2022] PUT /identity/v3/projects/2882b75beb1d4ed286184be2d8237bca/users/ee273d2386d44def91829a54fd075f6e/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:55.595060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.595351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.595629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.622452 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] MFA Rules not processed for user `ee273d2386d44def91829a54fd075f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:55.623679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:55.649957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1152/2292] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:56:55 2022] PUT /identity/v3/projects/be3e9354ba4e4d4bb5f55aa03c9985c5/users/192826b3ff234501aec7beeed935ab18/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:56:55.661320 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.661609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.661889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.693451 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] MFA Rules not processed for user `192826b3ff234501aec7beeed935ab18`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:56:55.694644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:55.698595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1141/2293] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:55.709739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.711229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:55.763570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1153/2294] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:56:55.775753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.777757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:55.781157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764a5ce-b497-43d2-8ba9-621466ee545e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.828988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.829637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.829924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.830194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.834887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aef7a0-06fa-40bb-90a4-17b962701adb None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.839191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.842086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.842086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.842086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.849184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.850617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.860068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1154/2295] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:55.897084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:55.898519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:55.908620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1142/2296] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:56:55.950978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:56:55.959488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa0a6-6fb0-4e63-8c67-4ce14ff38f73 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:56:55.963377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:56:55.964012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:56:55.964296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:56:55.964571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:56:55.966342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:56:56.024263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:56:56.025695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:56:56.034486 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1155/2297] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:56:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:03.620631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:03.622113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:03.686014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7d17-8d17-45dc-b806-69071cb79db8 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:03.690500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:03.691371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:03.691652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:03.691921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] PATH_INFO: `/v3/users/f12d89fe1feb44c094e1321c41deac60` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:03.693090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12d89fe1feb44c094e1321c41deac60)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:03.695024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:04.157203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12d89fe1feb44c094e1321c41deac60'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.162916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12d89fe1feb44c094e1321c41deac60'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.283880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12d89fe1feb44c094e1321c41deac60'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.284519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12d89fe1feb44c094e1321c41deac60'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.297869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-09c96d42-27ea-4340-9bc4-0f2752e2fc3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12d89fe1feb44c094e1321c41deac60'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.304185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1143/2298] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:03 2022] DELETE /identity/v3/users/f12d89fe1feb44c094e1321c41deac60 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:04.566852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:04.585780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078182ac-1f1d-4b60-83a0-0261690e1d7e service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:04.646049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:04.646940 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:04.647218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:04.647551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] PATH_INFO: `/v3/projects/4f78f5463ce84155836c42ee404f5665` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:04.649449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f78f5463ce84155836c42ee404f5665)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:04.651331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:04.798620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f78f5463ce84155836c42ee404f5665', 'request_id': 'req-f3c4ac58-28a0-4901-b956-84339062bb7a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.804203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f78f5463ce84155836c42ee404f5665', 'request_id': 'req-f3c4ac58-28a0-4901-b956-84339062bb7a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.912882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f78f5463ce84155836c42ee404f5665', 'request_id': 'req-f3c4ac58-28a0-4901-b956-84339062bb7a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.926313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] The token cache is being invalidate because project 4f78f5463ce84155836c42ee404f5665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:04.926601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.927295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-f3c4ac58-28a0-4901-b956-84339062bb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:04.928839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1156/2299] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:04 2022] DELETE /identity/v3/projects/4f78f5463ce84155836c42ee404f5665 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:04.935320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a850-1920-45d1-95e8-d6fed0ed281f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:04.935785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a850-1920-45d1-95e8-d6fed0ed281f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:04.935915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a850-1920-45d1-95e8-d6fed0ed281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:04.953848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-85f8a850-1920-45d1-95e8-d6fed0ed281f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:04.955079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-85f8a850-1920-45d1-95e8-d6fed0ed281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:05.015762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1144/2300] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:05.023789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d040-f735-4c19-be64-12cd89aa5e15 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.024082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d040-f735-4c19-be64-12cd89aa5e15 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.024419 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65d040-f735-4c19-be64-12cd89aa5e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.043427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-fb65d040-f735-4c19-be64-12cd89aa5e15 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:05.044631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-fb65d040-f735-4c19-be64-12cd89aa5e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:05.052627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1157/2301] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:05.056955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a850-1920-45d1-95e8-d6fed0ed281f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:05.066487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a850-1920-45d1-95e8-d6fed0ed281f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:05.071780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:05.072455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.072744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.073019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.073754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:05.074061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:05.075687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:05.091033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1145/2302] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:57:05.092127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65d040-f735-4c19-be64-12cd89aa5e15 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:05.101192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65d040-f735-4c19-be64-12cd89aa5e15 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:05.105944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:05.110135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.110135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.110135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.110135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:05.110135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:05.263935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1158/2303] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:05 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:05.268080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:05.278103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da098f-12e6-4001-aeb4-e9a12bd26d84 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:05.338898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:05.343545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.343545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.343545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.343545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:05.343545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:05.450238 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1146/2304] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:05 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:05.456642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:05.465390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa339b-1e95-4132-9bad-0219a6667bfb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:05.474229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:05.475342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.475719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.476072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.477543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:05.479242 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:05.490238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1159/2305] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:05.494477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:05.504568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7f75-7587-4d1d-8add-38c286bc1572 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:05.511135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030b96-8e36-4f99-b212-6465a13d2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:05.511814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030b96-8e36-4f99-b212-6465a13d2714 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.512097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030b96-8e36-4f99-b212-6465a13d2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.512369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030b96-8e36-4f99-b212-6465a13d2714 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.513113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030b96-8e36-4f99-b212-6465a13d2714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:05.515103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030b96-8e36-4f99-b212-6465a13d2714 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:05.525922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1147/2306] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:05.530085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:05.540251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac817b-e9f2-4938-aa76-760a94296acb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:05.544975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:05.548127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.548127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.548127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] PATH_INFO: `/v3/projects/0d6d22361e15484b959949428187f0dc/users/b608cfa822d64af1b0f967948d52f4c2/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.561502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6d22361e15484b959949428187f0dc, user_id=b608cfa822d64af1b0f967948d52f4c2, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:05.564196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:05.685085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1160/2307] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:05 2022] PUT /identity/v3/projects/0d6d22361e15484b959949428187f0dc/users/b608cfa822d64af1b0f967948d52f4c2/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:05.696540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.696828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.697106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.722747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] MFA Rules not processed for user `b608cfa822d64af1b0f967948d52f4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:05.724006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:05.790316 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1148/2308] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:05.801577 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:05.803490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:05.912002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4103e6-0710-4159-8ac2-6b25c35c9c30 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:05.918675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b019c2-088d-4c26-b714-bc859e6ff494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:05.919524 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b019c2-088d-4c26-b714-bc859e6ff494 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:05.919810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b019c2-088d-4c26-b714-bc859e6ff494 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:05.920098 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b019c2-088d-4c26-b714-bc859e6ff494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:05.928684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b019c2-088d-4c26-b714-bc859e6ff494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:05.930306 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b019c2-088d-4c26-b714-bc859e6ff494 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:05.939066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1161/2309] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:57:07.487621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:07.489077 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:07.550241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7871d-5ab5-49bd-9602-e7328898a4a0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:07.556128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:07.557009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:07.557291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:07.557566 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] PATH_INFO: `/v3/users/ac13fc490b7b46e693e0ba8e297d5d67` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:07.558847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac13fc490b7b46e693e0ba8e297d5d67)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:07.560798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:07.777913 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac13fc490b7b46e693e0ba8e297d5d67'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:07.784535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac13fc490b7b46e693e0ba8e297d5d67'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:07.876978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac13fc490b7b46e693e0ba8e297d5d67'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:07.877588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac13fc490b7b46e693e0ba8e297d5d67'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:07.889949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac13fc490b7b46e693e0ba8e297d5d67'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:07.895832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1149/2310] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:07 2022] DELETE /identity/v3/users/ac13fc490b7b46e693e0ba8e297d5d67 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:07.900311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:07.900782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:07.900873 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:07.918519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:07.919745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:07.975902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1162/2311] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:07.985982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:07.987426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:08.048967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400d31-3466-4873-9b10-c1e5536a807c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:08.052584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:08.053226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:08.053509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:08.053783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:08.063163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:08.064583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:08.073775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1150/2312] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:08.519032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:08.520766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:08.536709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e48e9-f5c5-4173-98c7-2e1981abd248 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:08.544613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:08.545525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:08.545801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:08.546062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] PATH_INFO: `/v3/projects/a6b74107ca0a40f78efe94f805b73451` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:08.547283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b74107ca0a40f78efe94f805b73451)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:08.549227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:08.701317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b74107ca0a40f78efe94f805b73451', 'request_id': 'req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:08.706640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b74107ca0a40f78efe94f805b73451', 'request_id': 'req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:08.775570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b74107ca0a40f78efe94f805b73451', 'request_id': 'req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:08.786891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] The token cache is being invalidate because project a6b74107ca0a40f78efe94f805b73451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:08.787178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:08.787805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:08.789366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1163/2313] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:08 2022] DELETE /identity/v3/projects/a6b74107ca0a40f78efe94f805b73451 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:08.793213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:08.802787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689212c-26ba-401b-a60a-d777ed3cf7f6 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:08.856934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:08.857802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:08.858082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:08.858358 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] PATH_INFO: `/v3/users/ee273d2386d44def91829a54fd075f6e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:08.859591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee273d2386d44def91829a54fd075f6e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:08.861555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:09.084515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee273d2386d44def91829a54fd075f6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.091009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee273d2386d44def91829a54fd075f6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.173647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee273d2386d44def91829a54fd075f6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.174257 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee273d2386d44def91829a54fd075f6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.186249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a28198e7-519f-463c-8358-838538349b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee273d2386d44def91829a54fd075f6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.191989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1151/2314] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:08 2022] DELETE /identity/v3/users/ee273d2386d44def91829a54fd075f6e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:09.623374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:09.628299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:09.640105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782ddb-de3e-4e25-a9f3-d6028fe7f1fc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:09.697874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:09.698753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:09.699036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:09.699308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] PATH_INFO: `/v3/projects/2882b75beb1d4ed286184be2d8237bca` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:09.700505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2882b75beb1d4ed286184be2d8237bca)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:09.702389 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:09.803735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2882b75beb1d4ed286184be2d8237bca', 'request_id': 'req-afb25c8b-d712-4414-9cd2-7333608ce428'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.808988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2882b75beb1d4ed286184be2d8237bca', 'request_id': 'req-afb25c8b-d712-4414-9cd2-7333608ce428'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.866340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2882b75beb1d4ed286184be2d8237bca', 'request_id': 'req-afb25c8b-d712-4414-9cd2-7333608ce428'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.882436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] The token cache is being invalidate because project 2882b75beb1d4ed286184be2d8237bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:09.884543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.884543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-afb25c8b-d712-4414-9cd2-7333608ce428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:09.884982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1164/2315] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:09 2022] DELETE /identity/v3/projects/2882b75beb1d4ed286184be2d8237bca => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:09.890749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb57c89-65fe-46a7-adf2-3c0fbd8392ab None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:09.891215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb57c89-65fe-46a7-adf2-3c0fbd8392ab None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:09.891318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb57c89-65fe-46a7-adf2-3c0fbd8392ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:09.909188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-fbb57c89-65fe-46a7-adf2-3c0fbd8392ab None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:09.910383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fbb57c89-65fe-46a7-adf2-3c0fbd8392ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:09.966124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1152/2316] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:09.975081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922f74-ce1f-4143-b858-58383324e037 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:09.975372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922f74-ce1f-4143-b858-58383324e037 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:09.975673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922f74-ce1f-4143-b858-58383324e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:09.995079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2a922f74-ce1f-4143-b858-58383324e037 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:09.996504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2a922f74-ce1f-4143-b858-58383324e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:10.009558 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1165/2317] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:10.010996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb57c89-65fe-46a7-adf2-3c0fbd8392ab None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.020443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb57c89-65fe-46a7-adf2-3c0fbd8392ab None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.025512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.027233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.027233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.027233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.028444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:10.028444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.029321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:10.041941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1153/2318] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:57:10.045909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a922f74-ce1f-4143-b858-58383324e037 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.055140 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a922f74-ce1f-4143-b858-58383324e037 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.060182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.060840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.061119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.061391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.062129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.064051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:10.149111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1166/2319] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:10 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:10.153070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.163582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b4fcb-16a2-4689-8c1e-2e45bb04f838 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.219911 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.220886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.221177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.221455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.222160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.224366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:10.345318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1154/2320] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:10 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:10.349323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.359590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b6b69-995f-4a51-bb3b-b8db8d8aa98b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.364205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.364858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.365142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.365424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.366181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.368395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:10.378775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1167/2321] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:10.382601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.392921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f908d-af66-4282-9c31-d22122186e0b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.397636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cce955-3c05-4b87-9009-2a8ea45f8056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.398287 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce955-3c05-4b87-9009-2a8ea45f8056 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.399181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce955-3c05-4b87-9009-2a8ea45f8056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.399488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce955-3c05-4b87-9009-2a8ea45f8056 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.400231 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cce955-3c05-4b87-9009-2a8ea45f8056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.401859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cce955-3c05-4b87-9009-2a8ea45f8056 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:10.411509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1155/2322] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:10.415164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.424737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cc468-17bc-4e5c-9c1e-168a1f30881b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.429308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.430662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.430984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.431256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] PATH_INFO: `/v3/projects/8440911332464a6ea1012c9615b53f57/users/909fc134b06e4e3c910448bbeb021808/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.445005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8440911332464a6ea1012c9615b53f57, user_id=909fc134b06e4e3c910448bbeb021808, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.448194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:10.517217 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1168/2323] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:10 2022] PUT /identity/v3/projects/8440911332464a6ea1012c9615b53f57/users/909fc134b06e4e3c910448bbeb021808/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:10.534324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ce4c-6777-4f61-8f46-5ffc68f7e7e1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.534920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ce4c-6777-4f61-8f46-5ffc68f7e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.535199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ce4c-6777-4f61-8f46-5ffc68f7e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.566020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4ea1ce4c-6777-4f61-8f46-5ffc68f7e7e1 None None] MFA Rules not processed for user `909fc134b06e4e3c910448bbeb021808`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:10.567269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4ea1ce4c-6777-4f61-8f46-5ffc68f7e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:10.630837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1156/2324] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:10.635313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.694268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69091fd-f9d6-48eb-b4e6-93b7cb113314 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.698971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.699618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.699900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.700174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.700880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.702786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:10.792278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1169/2325] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:10 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:10.796740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1ce4c-6777-4f61-8f46-5ffc68f7e7e1 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:10.807843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1ce4c-6777-4f61-8f46-5ffc68f7e7e1 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:10.861903 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:10.862568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:10.862884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:10.863166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:10.863855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:10.865739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:11.008624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1157/2326] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:10 2022] POST /identity/v3/users => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:11.012398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:11.022480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa739f-fed7-4313-9d81-00458947532a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:11.027213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:11.027854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:11.028138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:11.028412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:11.029149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:11.030765 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:11.041715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1170/2327] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:11.045796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:11.056430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a3df-c4ae-4d47-bf77-c1556329190b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:11.061263 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:11.062135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:11.062415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:11.062689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] PATH_INFO: `/v3/projects/c4f8de284abf4fd18d2290b0b8e4142a/users/c088e8c6d281433cb7dd2d0d35afc146/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:11.077797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f8de284abf4fd18d2290b0b8e4142a, user_id=c088e8c6d281433cb7dd2d0d35afc146, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:11.080486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:11.163781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1158/2328] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:11 2022] PUT /identity/v3/projects/c4f8de284abf4fd18d2290b0b8e4142a/users/c088e8c6d281433cb7dd2d0d35afc146/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:11.167682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:11.178363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c2f4f-4ece-4faf-bf84-1027b221724c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:11.238532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7fd20-af82-4ee1-9a11-b9304873498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:11.239233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7fd20-af82-4ee1-9a11-b9304873498a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:11.239514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7fd20-af82-4ee1-9a11-b9304873498a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:11.239785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7fd20-af82-4ee1-9a11-b9304873498a admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:11.240548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7fd20-af82-4ee1-9a11-b9304873498a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:11.243084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7fd20-af82-4ee1-9a11-b9304873498a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:11.254275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1171/2329] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:11.258750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:11.269143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00e46c-a226-44f1-a8cf-c486fe004862 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:11.274234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:11.275187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:11.275475 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:11.275755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] PATH_INFO: `/v3/projects/c4f8de284abf4fd18d2290b0b8e4142a/users/c088e8c6d281433cb7dd2d0d35afc146/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:11.277780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f8de284abf4fd18d2290b0b8e4142a, user_id=c088e8c6d281433cb7dd2d0d35afc146, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:11.280477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:11.291089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1159/2330] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:11 2022] PUT /identity/v3/projects/c4f8de284abf4fd18d2290b0b8e4142a/users/c088e8c6d281433cb7dd2d0d35afc146/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:11.302118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea077-0b6d-4a1e-9d30-13c21790276b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:11.302408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea077-0b6d-4a1e-9d30-13c21790276b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:11.302686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea077-0b6d-4a1e-9d30-13c21790276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:11.329804 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-9f2ea077-0b6d-4a1e-9d30-13c21790276b None None] MFA Rules not processed for user `c088e8c6d281433cb7dd2d0d35afc146`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:11.331017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9f2ea077-0b6d-4a1e-9d30-13c21790276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:11.404204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1172/2331] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:11.413262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:11.415134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:11.471094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a9c9-0733-4e98-b63c-9d914e27511e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:11.474815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63df77-233b-4659-b4fe-6ad44528e1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:11.475393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63df77-233b-4659-b4fe-6ad44528e1da service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:11.475675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63df77-233b-4659-b4fe-6ad44528e1da service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:11.475948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63df77-233b-4659-b4fe-6ad44528e1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:11.486028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63df77-233b-4659-b4fe-6ad44528e1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:11.487515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63df77-233b-4659-b4fe-6ad44528e1da service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:11.497613 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1160/2332] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:11.682025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ea077-0b6d-4a1e-9d30-13c21790276b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:11.742423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ea077-0b6d-4a1e-9d30-13c21790276b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:11.747345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:11.769840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:11.769840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:11.769840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] PATH_INFO: `/v3/users/909fc134b06e4e3c910448bbeb021808` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:11.769840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909fc134b06e4e3c910448bbeb021808)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:11.769840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:11.989589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909fc134b06e4e3c910448bbeb021808'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:11.997160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909fc134b06e4e3c910448bbeb021808'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:11.997911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909fc134b06e4e3c910448bbeb021808'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:12.123759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909fc134b06e4e3c910448bbeb021808'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:12.135977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909fc134b06e4e3c910448bbeb021808'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:12.141924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1173/2333] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:11 2022] DELETE /identity/v3/users/909fc134b06e4e3c910448bbeb021808 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:12.146855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:12.147341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:12.147435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:12.168446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:12.169800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:12.229995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1161/2334] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:12.239672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:12.241059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:12.306639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9154eb-ceb7-4835-b875-c811e19d0b13 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:12.310454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:12.311144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:12.311429 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:12.311710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:12.321512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:12.323012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:12.332576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1174/2335] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:13.138356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:13.140142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:13.155553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8054f-e9e3-4698-a184-df26c6696b4b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:13.161613 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:13.163127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:13.163410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:13.163690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] PATH_INFO: `/v3/projects/8440911332464a6ea1012c9615b53f57` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:13.165115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8440911332464a6ea1012c9615b53f57)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:13.167091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:13.345270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8440911332464a6ea1012c9615b53f57', 'request_id': 'req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.351337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8440911332464a6ea1012c9615b53f57', 'request_id': 'req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.466871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8440911332464a6ea1012c9615b53f57', 'request_id': 'req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.478448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] The token cache is being invalidate because project 8440911332464a6ea1012c9615b53f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:13.478719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.479382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.480907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1162/2336] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:13 2022] DELETE /identity/v3/projects/8440911332464a6ea1012c9615b53f57 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:13.484940 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:13.495273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb36e-b57a-4071-8dc9-d3250849d1ca service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:13.555669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:13.556176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:13.556442 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:13.556716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] PATH_INFO: `/v3/users/c088e8c6d281433cb7dd2d0d35afc146` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:13.557975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c088e8c6d281433cb7dd2d0d35afc146)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:13.566861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:13.765352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c088e8c6d281433cb7dd2d0d35afc146'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.771826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c088e8c6d281433cb7dd2d0d35afc146'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.772477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c088e8c6d281433cb7dd2d0d35afc146'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.884030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c088e8c6d281433cb7dd2d0d35afc146'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.897064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c088e8c6d281433cb7dd2d0d35afc146'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:13.904670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1175/2337] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:13 2022] DELETE /identity/v3/users/c088e8c6d281433cb7dd2d0d35afc146 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:14.338484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:14.341732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:14.358659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb179ae3-cb6a-46ab-bcd9-1f89c0a5e7d2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:14.425197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:14.426227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:14.426510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:14.427015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] PATH_INFO: `/v3/projects/c4f8de284abf4fd18d2290b0b8e4142a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:14.430280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f8de284abf4fd18d2290b0b8e4142a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:14.430793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:14.439987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:14.441719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:14.455642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46674ca-2acf-4066-9e80-62595c9cf12e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:14.460299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:14.463099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:14.463099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:14.463099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] PATH_INFO: `/v3/users/b608cfa822d64af1b0f967948d52f4c2` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:14.463099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b608cfa822d64af1b0f967948d52f4c2)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:14.465323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:14.603915 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f8de284abf4fd18d2290b0b8e4142a', 'request_id': 'req-6232da61-d9b7-416e-ba68-94c43fe26f5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.609204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f8de284abf4fd18d2290b0b8e4142a', 'request_id': 'req-6232da61-d9b7-416e-ba68-94c43fe26f5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.712457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f8de284abf4fd18d2290b0b8e4142a', 'request_id': 'req-6232da61-d9b7-416e-ba68-94c43fe26f5d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.731096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] The token cache is being invalidate because project c4f8de284abf4fd18d2290b0b8e4142a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:14.731451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.732195 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6232da61-d9b7-416e-ba68-94c43fe26f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.734098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1163/2338] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:14 2022] DELETE /identity/v3/projects/c4f8de284abf4fd18d2290b0b8e4142a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:14.741106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238cbf-c98c-4a5c-af6f-3c74303da32e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:14.741618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238cbf-c98c-4a5c-af6f-3c74303da32e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:14.742930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238cbf-c98c-4a5c-af6f-3c74303da32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:14.772141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f8238cbf-c98c-4a5c-af6f-3c74303da32e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:14.774349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f8238cbf-c98c-4a5c-af6f-3c74303da32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:14.779988 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b608cfa822d64af1b0f967948d52f4c2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.793281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b608cfa822d64af1b0f967948d52f4c2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.794142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b608cfa822d64af1b0f967948d52f4c2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.873609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1164/2339] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:14.888437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a081-ebb8-4ba3-ba69-62675c4be8a3 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:14.888732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a081-ebb8-4ba3-ba69-62675c4be8a3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:14.889020 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a081-ebb8-4ba3-ba69-62675c4be8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:14.906991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b608cfa822d64af1b0f967948d52f4c2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.921306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-1d48a081-ebb8-4ba3-ba69-62675c4be8a3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:14.923075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-02e9fdd5-0add-4565-b5d3-253e37667308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b608cfa822d64af1b0f967948d52f4c2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:14.923860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1d48a081-ebb8-4ba3-ba69-62675c4be8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:14.930204 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1176/2340] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:14 2022] DELETE /identity/v3/users/b608cfa822d64af1b0f967948d52f4c2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:14.933881 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1165/2341] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:14.938107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbd144-5021-4b8b-b94a-383d38714adf None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:14.938107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbd144-5021-4b8b-b94a-383d38714adf None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:14.938107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbd144-5021-4b8b-b94a-383d38714adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:14.948417 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48a081-ebb8-4ba3-ba69-62675c4be8a3 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:14.957256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48a081-ebb8-4ba3-ba69-62675c4be8a3 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:14.962876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-a7bbd144-5021-4b8b-b94a-383d38714adf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:14.964468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a7bbd144-5021-4b8b-b94a-383d38714adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:15.022030 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.022807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.023172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.024026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.024840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:15.025205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.026894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.040014 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1177/2342] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:15.046012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1166/2343] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:57:15.047743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbd144-5021-4b8b-b94a-383d38714adf None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.049802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.051727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:15.059626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbd144-5021-4b8b-b94a-383d38714adf None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.064313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.068589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.068589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.068589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.068589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.068589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.107721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691471d5-5e72-4028-8e4f-39d442b4fc30 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.111531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.112198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.112464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.112738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.122785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.124269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.133513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1167/2344] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:15.196636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1178/2345] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:15 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:15.198341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.208692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1111304-4e78-494e-8c15-c439fd09769f service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.264755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.265421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.265702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.265975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.266674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.268620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.396036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1168/2346] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:15 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:15.398031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.409166 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b290606-e0dd-43bd-858f-c9ae5b4acff6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.413960 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.414826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.417869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.417869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.417869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.417869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.433677 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1179/2347] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:15.437757 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.452882 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb20fd-0c12-424f-964a-4b18722182b9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.458015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.458683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.459049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.459370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.460173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.462345 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.481814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1169/2348] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:15.486181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.503869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f86aa5-3a91-46cc-b68b-89bbd31bcce2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.506712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c655d-f7eb-4de6-b42c-5c98ac4b012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.508240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c655d-f7eb-4de6-b42c-5c98ac4b012e admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.508703 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c655d-f7eb-4de6-b42c-5c98ac4b012e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.509121 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c655d-f7eb-4de6-b42c-5c98ac4b012e admin admin] PATH_INFO: `/v3/projects/24137a568aa8432c93f2d21f7925bbb8/users/ef00c6e9942c4f099b49fb903eb26587/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.528417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c655d-f7eb-4de6-b42c-5c98ac4b012e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24137a568aa8432c93f2d21f7925bbb8, user_id=ef00c6e9942c4f099b49fb903eb26587, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.533277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c655d-f7eb-4de6-b42c-5c98ac4b012e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.600095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.601954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:15.615296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00e445-32a4-49f1-8db3-18412d0ff6b9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.626948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.631240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.631240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.631240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] PATH_INFO: `/v3/projects/0d6d22361e15484b959949428187f0dc` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.633774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6d22361e15484b959949428187f0dc)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.637221 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.653351 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1180/2349] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:15 2022] PUT /identity/v3/projects/24137a568aa8432c93f2d21f7925bbb8/users/ef00c6e9942c4f099b49fb903eb26587/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:15.656809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b0f23-2781-4627-a20c-f9da9efda085 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.657184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b0f23-2781-4627-a20c-f9da9efda085 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.657517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b0f23-2781-4627-a20c-f9da9efda085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.688432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-0a7b0f23-2781-4627-a20c-f9da9efda085 None None] MFA Rules not processed for user `ef00c6e9942c4f099b49fb903eb26587`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:15.689708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0a7b0f23-2781-4627-a20c-f9da9efda085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:15.754644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1181/2350] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:15.759948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b0f23-2781-4627-a20c-f9da9efda085 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:15.807715 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6d22361e15484b959949428187f0dc', 'request_id': 'req-08a426a3-22a5-4434-b705-5091ae2345cb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:15.813277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6d22361e15484b959949428187f0dc', 'request_id': 'req-08a426a3-22a5-4434-b705-5091ae2345cb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:15.822617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b0f23-2781-4627-a20c-f9da9efda085 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:15.880108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:15.880875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.881229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.881717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:15.882494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:15.885190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:15.958157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6d22361e15484b959949428187f0dc', 'request_id': 'req-08a426a3-22a5-4434-b705-5091ae2345cb'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:15.973866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] The token cache is being invalidate because project 0d6d22361e15484b959949428187f0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:15.974157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:15.974927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-08a426a3-22a5-4434-b705-5091ae2345cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:15.978765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1170/2351] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:15 2022] DELETE /identity/v3/projects/0d6d22361e15484b959949428187f0dc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:15.982270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb545-1f31-4821-805e-877b57824405 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:15.982773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb545-1f31-4821-805e-877b57824405 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:15.983120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb545-1f31-4821-805e-877b57824405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.004831 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-11dbb545-1f31-4821-805e-877b57824405 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:16.006072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-11dbb545-1f31-4821-805e-877b57824405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:16.016147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1171/2352] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:16.025201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a437-2fac-4dd5-9373-668248b0e845 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.025733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a437-2fac-4dd5-9373-668248b0e845 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.026215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a437-2fac-4dd5-9373-668248b0e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.046217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ad16a437-2fac-4dd5-9373-668248b0e845 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:16.048525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ad16a437-2fac-4dd5-9373-668248b0e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:16.059765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1172/2353] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:16.067038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a437-2fac-4dd5-9373-668248b0e845 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.075629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1182/2354] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:15 2022] POST /identity/v3/projects => generated 383 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:16.079622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a437-2fac-4dd5-9373-668248b0e845 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.084590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.087088 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:16.163178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.163986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.164333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.164697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.165785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:16.166042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cae2d-a0e3-432b-a5ca-d7ddcf30b453 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.166157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.168008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.171526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.172268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.172624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.172974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.173762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.176244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.188739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1173/2355] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:57:16.188739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.200721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eeb18-19e5-489c-98d2-1beff76f9ccc admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.205469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.206127 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.206406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.206680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.207420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.209336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.301358 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1183/2356] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:16 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:16.305346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.315272 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7b759-eebd-4356-ac76-717c42a36879 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.319902 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.321113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.321399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.321676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.322470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.324097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.331747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1174/2357] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:16 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:16.334541 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1184/2358] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:16.342139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.342359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.352145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4906-431b-4e82-a499-7b3f2d9ddbd7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.404708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705155fa-dbbb-4c2f-8232-d9b7f2c298f2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.408424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.409174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.409457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.409660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.409786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] PATH_INFO: `/v3/projects/72b80276afc54ba3a4371a6cf740c777/users/fd80379d6c694cb59b629b1c5782ea08/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.410299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.410584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.410896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.411602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.413546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.425840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b80276afc54ba3a4371a6cf740c777, user_id=fd80379d6c694cb59b629b1c5782ea08, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.428462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.586817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1175/2359] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:16 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:16.590823 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.602845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1185/2360] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:16 2022] PUT /identity/v3/projects/72b80276afc54ba3a4371a6cf740c777/users/fd80379d6c694cb59b629b1c5782ea08/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:16.603023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120df3d-3f44-450a-bdfa-5281b1bbed71 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.606920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.664909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.664909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.664909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.664909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.665548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.665548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.670993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e41bc7-e9a8-4ace-86f2-8f419e409fb4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.675730 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1176/2361] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:16.679228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.679993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.680381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.680662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.680937 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.681712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.683329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.689795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7716e30-37a5-4f93-8939-5f2a8e7c438d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.698049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1186/2362] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:16.698291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.698291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.698291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.698291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.698660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.698806 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.699029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.708840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95934-4941-40f4-b5f9-6da542f0ab68 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.709018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1177/2363] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:16.713021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.715847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ddca6-bd86-42d2-b2fa-cd59c3041e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.716750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddca6-bd86-42d2-b2fa-cd59c3041e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.717028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddca6-bd86-42d2-b2fa-cd59c3041e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.717303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddca6-bd86-42d2-b2fa-cd59c3041e37 admin admin] PATH_INFO: `/v3/projects/72b80276afc54ba3a4371a6cf740c777/users/fd80379d6c694cb59b629b1c5782ea08/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.719335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ddca6-bd86-42d2-b2fa-cd59c3041e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b80276afc54ba3a4371a6cf740c777, user_id=fd80379d6c694cb59b629b1c5782ea08, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.721977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ddca6-bd86-42d2-b2fa-cd59c3041e37 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.722933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514335e-30e6-41e5-9866-978254870455 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.727651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d01e8-c3e6-4e09-85d1-f372fe1f03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.728520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d01e8-c3e6-4e09-85d1-f372fe1f03cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.728802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d01e8-c3e6-4e09-85d1-f372fe1f03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.729075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d01e8-c3e6-4e09-85d1-f372fe1f03cd admin admin] PATH_INFO: `/v3/projects/5e890d5a496a4709a285e74c54aee322/users/373a656fe30345588c0a87800ff32fa3/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.732401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1187/2364] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:16 2022] PUT /identity/v3/projects/72b80276afc54ba3a4371a6cf740c777/users/fd80379d6c694cb59b629b1c5782ea08/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:16.744317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d01e8-c3e6-4e09-85d1-f372fe1f03cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e890d5a496a4709a285e74c54aee322, user_id=373a656fe30345588c0a87800ff32fa3, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:16.744609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.744942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.745277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.747017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d01e8-c3e6-4e09-85d1-f372fe1f03cd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:16.771866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] MFA Rules not processed for user `fd80379d6c694cb59b629b1c5782ea08`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:16.773058 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:16.840354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1188/2365] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:16.868663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:16.870048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:16.925555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35313d68-ea22-4ff3-a4f1-14f917287eef None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:16.929753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1178/2366] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:16 2022] PUT /identity/v3/projects/5e890d5a496a4709a285e74c54aee322/users/373a656fe30345588c0a87800ff32fa3/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:16.940384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a55b92-8fbf-4e1c-b0d3-8ad0de84377e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.940663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a55b92-8fbf-4e1c-b0d3-8ad0de84377e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.940934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a55b92-8fbf-4e1c-b0d3-8ad0de84377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:16.968377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d8a55b92-8fbf-4e1c-b0d3-8ad0de84377e None None] MFA Rules not processed for user `373a656fe30345588c0a87800ff32fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:16.969562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d8a55b92-8fbf-4e1c-b0d3-8ad0de84377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:16.974661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:16.975346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:16.975625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:16.975899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.035488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.037049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.037227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1179/2367] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:17.042340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a55b92-8fbf-4e1c-b0d3-8ad0de84377e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:17.049347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1189/2368] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:57:17.105646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a55b92-8fbf-4e1c-b0d3-8ad0de84377e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:17.113001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:17.113706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.114022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.114791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.115081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.117552 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.252912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:17.261483 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6d79c-6525-4b59-9966-5d968a6729a2 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:17.265352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:17.265974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.266378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.266847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.268548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:17.307814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1180/2369] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:17 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:17.311369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:17.329513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.330987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.341171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1190/2370] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:17.374884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ed308-689a-43b7-90ce-875431a62913 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:17.378214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:17.378923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.379215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.379471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.380173 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.382080 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.545572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1181/2371] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:17 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:17.546449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:17.562444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ce51-e9a7-4353-b7be-6d1c3286137e service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:17.573428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:17.573428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.573428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.573428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.574051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.574051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.587392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1191/2372] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:17.594147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:17.603541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba2c25-fb1b-4380-a847-6836013d15a0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:17.608471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:17.609371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.609655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.609931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] PATH_INFO: `/v3/projects/2a076638f5fc4ab1b70ca28da9f77501/users/38dc591db94b4c578a26fde203785be2/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.628484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a076638f5fc4ab1b70ca28da9f77501, user_id=38dc591db94b4c578a26fde203785be2, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.629868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.789268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1182/2373] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:17 2022] PUT /identity/v3/projects/2a076638f5fc4ab1b70ca28da9f77501/users/38dc591db94b4c578a26fde203785be2/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:17.792154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:17.801659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ef9ea-b701-4b60-8bbb-2c624fd01f51 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:17.857598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a8f67-6805-4d7b-ad33-83f991799c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:17.858280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a8f67-6805-4d7b-ad33-83f991799c79 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.858520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a8f67-6805-4d7b-ad33-83f991799c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.858818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a8f67-6805-4d7b-ad33-83f991799c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.859551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a8f67-6805-4d7b-ad33-83f991799c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.861176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a8f67-6805-4d7b-ad33-83f991799c79 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.871539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1192/2374] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:17.875876 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:17.886018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8c001-d92e-49f0-aa49-c9dbbbcb004f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:17.890655 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:17.891559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.891841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.892112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] PATH_INFO: `/v3/projects/2a076638f5fc4ab1b70ca28da9f77501/users/38dc591db94b4c578a26fde203785be2/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.894140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a076638f5fc4ab1b70ca28da9f77501, user_id=38dc591db94b4c578a26fde203785be2, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:17.896837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:17.910268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1183/2375] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:17 2022] PUT /identity/v3/projects/2a076638f5fc4ab1b70ca28da9f77501/users/38dc591db94b4c578a26fde203785be2/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:17.920670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff51d-f4e6-4422-a916-239f98b3c97d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:17.920961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff51d-f4e6-4422-a916-239f98b3c97d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:17.921241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff51d-f4e6-4422-a916-239f98b3c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:17.950557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-a89ff51d-f4e6-4422-a916-239f98b3c97d None None] MFA Rules not processed for user `38dc591db94b4c578a26fde203785be2`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:17.950557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a89ff51d-f4e6-4422-a916-239f98b3c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:17.968551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:18.027380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1193/2376] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:18.037571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ff51d-f4e6-4422-a916-239f98b3c97d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:18.043171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfbc2a-e0f6-4c1e-a929-f52e9e18f6cd admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:18.049935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:18.050838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:18.051125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:18.051409 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] PATH_INFO: `/v3/users/ef00c6e9942c4f099b49fb903eb26587` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:18.052643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef00c6e9942c4f099b49fb903eb26587)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:18.054586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:18.092122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ff51d-f4e6-4422-a916-239f98b3c97d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:18.095854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:18.096490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:18.096772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:18.097040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:18.108115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:18.116813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:18.122175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1194/2377] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:57:18.150183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:18.160579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bbd5-215e-4593-829f-221e39261047 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:18.165748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:18.166607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:18.167102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:18.167501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] PATH_INFO: `/v3/users/373a656fe30345588c0a87800ff32fa3` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:18.168717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=373a656fe30345588c0a87800ff32fa3)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:18.170697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:18.405727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef00c6e9942c4f099b49fb903eb26587'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.415585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef00c6e9942c4f099b49fb903eb26587'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.626689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef00c6e9942c4f099b49fb903eb26587'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.631646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef00c6e9942c4f099b49fb903eb26587'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.640357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-47058697-d185-4acc-9327-e9edb77d7f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef00c6e9942c4f099b49fb903eb26587'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.642162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373a656fe30345588c0a87800ff32fa3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.646541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1184/2378] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:17 2022] DELETE /identity/v3/users/ef00c6e9942c4f099b49fb903eb26587 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:18.650354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373a656fe30345588c0a87800ff32fa3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.650678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373a656fe30345588c0a87800ff32fa3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.651583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:18.651871 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:18.652148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:18.675221 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:18.676472 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:18.735985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1185/2379] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:18.745478 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:18.746922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:18.801537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f5c3-3f72-4986-be35-7e3c42212334 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:18.805987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131579e8-7540-4444-8fb4-30378afd5e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:18.806626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131579e8-7540-4444-8fb4-30378afd5e16 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:18.806930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131579e8-7540-4444-8fb4-30378afd5e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:18.807223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131579e8-7540-4444-8fb4-30378afd5e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:18.816408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131579e8-7540-4444-8fb4-30378afd5e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:18.817847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131579e8-7540-4444-8fb4-30378afd5e16 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:18.828635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1186/2380] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:57:18.832175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373a656fe30345588c0a87800ff32fa3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.845129 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373a656fe30345588c0a87800ff32fa3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:18.851271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1195/2381] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:18 2022] DELETE /identity/v3/users/373a656fe30345588c0a87800ff32fa3 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:18.856284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:18.856569 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:18.856854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:18.874760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:18.875971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:18.934148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1187/2382] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:18.943702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:19.000327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd987c-f10c-42e3-af32-17167e416dfa admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:19.004188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:19.004830 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:19.005111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:19.005384 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:19.015056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:19.016522 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:19.026122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1196/2383] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:19.320764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:19.322308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:19.341944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41bd82-0d36-45c8-8d63-74ba7c4d972b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:19.345658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:19.346597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:19.350427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:19.350427 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] PATH_INFO: `/v3/projects/24137a568aa8432c93f2d21f7925bbb8` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:19.363378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=24137a568aa8432c93f2d21f7925bbb8)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:19.368110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:19.518411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24137a568aa8432c93f2d21f7925bbb8', 'request_id': 'req-cd327e80-7a96-4633-9c9d-ce804b9629ff'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.526632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24137a568aa8432c93f2d21f7925bbb8', 'request_id': 'req-cd327e80-7a96-4633-9c9d-ce804b9629ff'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.553660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:19.555777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:19.568903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6efa1-3bd8-4ce1-8f18-46e72eb80937 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:19.631020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:19.632538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:19.632538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:19.632538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] PATH_INFO: `/v3/projects/5e890d5a496a4709a285e74c54aee322` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:19.633673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e890d5a496a4709a285e74c54aee322)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:19.635605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:19.648765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24137a568aa8432c93f2d21f7925bbb8', 'request_id': 'req-cd327e80-7a96-4633-9c9d-ce804b9629ff'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.655645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] The token cache is being invalidate because project 24137a568aa8432c93f2d21f7925bbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:19.655645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.656627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.659163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1188/2384] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:19 2022] DELETE /identity/v3/projects/24137a568aa8432c93f2d21f7925bbb8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:19.662653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:19.664865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:19.683453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327e80-7a96-4633-9c9d-ce804b9629ff admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:19.688281 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:19.689363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:19.689639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:19.689908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] PATH_INFO: `/v3/users/fd80379d6c694cb59b629b1c5782ea08` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:19.693121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd80379d6c694cb59b629b1c5782ea08)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:19.693301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:19.762689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e890d5a496a4709a285e74c54aee322', 'request_id': 'req-2cadd34a-6b5e-451b-9437-539b621d52e2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.767922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e890d5a496a4709a285e74c54aee322', 'request_id': 'req-2cadd34a-6b5e-451b-9437-539b621d52e2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.952380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e890d5a496a4709a285e74c54aee322', 'request_id': 'req-2cadd34a-6b5e-451b-9437-539b621d52e2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.964532 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] The token cache is being invalidate because project 5e890d5a496a4709a285e74c54aee322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:19.964747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.965383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.966946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1197/2385] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:19 2022] DELETE /identity/v3/projects/5e890d5a496a4709a285e74c54aee322 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:19.970717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:19.972023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:19.989387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd80379d6c694cb59b629b1c5782ea08'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:19.996840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd80379d6c694cb59b629b1c5782ea08'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.035872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadd34a-6b5e-451b-9437-539b621d52e2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:20.040511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:20.041379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:20.041662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:20.041939 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] PATH_INFO: `/v3/users/38dc591db94b4c578a26fde203785be2` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:20.043170 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38dc591db94b4c578a26fde203785be2)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:20.045146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:20.105179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd80379d6c694cb59b629b1c5782ea08'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.105809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd80379d6c694cb59b629b1c5782ea08'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.118236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd80379d6c694cb59b629b1c5782ea08'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.124275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1189/2386] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:19 2022] DELETE /identity/v3/users/fd80379d6c694cb59b629b1c5782ea08 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:20.360875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dc591db94b4c578a26fde203785be2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.368841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dc591db94b4c578a26fde203785be2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.370043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dc591db94b4c578a26fde203785be2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.460674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dc591db94b4c578a26fde203785be2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.472954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b3a34ed4-51c2-48d2-b0db-43d92c208448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dc591db94b4c578a26fde203785be2'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.478670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1198/2387] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:19 2022] DELETE /identity/v3/users/38dc591db94b4c578a26fde203785be2 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:20.573836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:20.575289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:20.641595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e865b4-49bd-4093-b207-4c72a7ed8446 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:20.698818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:20.698818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:20.701197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:20.701197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] PATH_INFO: `/v3/projects/72b80276afc54ba3a4371a6cf740c777` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:20.701197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b80276afc54ba3a4371a6cf740c777)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:20.702750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:20.837998 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b80276afc54ba3a4371a6cf740c777', 'request_id': 'req-ec0be759-e2d8-4018-81f9-f70566aaaa17'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.843669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b80276afc54ba3a4371a6cf740c777', 'request_id': 'req-ec0be759-e2d8-4018-81f9-f70566aaaa17'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.923812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b80276afc54ba3a4371a6cf740c777', 'request_id': 'req-ec0be759-e2d8-4018-81f9-f70566aaaa17'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.936077 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] The token cache is being invalidate because project 72b80276afc54ba3a4371a6cf740c777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:20.936359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.936988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-ec0be759-e2d8-4018-81f9-f70566aaaa17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:20.938496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1190/2388] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:20 2022] DELETE /identity/v3/projects/72b80276afc54ba3a4371a6cf740c777 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:20.944322 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:20.944639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:20.944912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:20.962749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:20.963946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.020562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1199/2389] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:21.028423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429657-e319-47de-a5b5-0899431eaf16 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.028710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429657-e319-47de-a5b5-0899431eaf16 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.028989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429657-e319-47de-a5b5-0899431eaf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.045056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.046509 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.048213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-39429657-e319-47de-a5b5-0899431eaf16 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:21.049396 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-39429657-e319-47de-a5b5-0899431eaf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.058338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1191/2390] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:21.059466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60c809-513f-420e-9a6f-32e49ee3d9b5 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.062485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39429657-e319-47de-a5b5-0899431eaf16 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.063991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.064866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.065151 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.065429 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] PATH_INFO: `/v3/projects/2a076638f5fc4ab1b70ca28da9f77501` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.066662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a076638f5fc4ab1b70ca28da9f77501)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.068609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.072536 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39429657-e319-47de-a5b5-0899431eaf16 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.079924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.080589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.080898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.081176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.081929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:21.082223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.083856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.096502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1192/2391] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:57:21.100914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.110539 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4278e-a3f6-403b-a819-8a2813543ac0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.115169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.115797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.116079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.116355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.117608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.119519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.237575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a076638f5fc4ab1b70ca28da9f77501', 'request_id': 'req-df9254dd-38c6-436b-896d-fd136871bd91'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:21.243037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a076638f5fc4ab1b70ca28da9f77501', 'request_id': 'req-df9254dd-38c6-436b-896d-fd136871bd91'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:21.260379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1193/2392] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:21.264585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.322862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17235-66b0-41ba-8443-71e26250310c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.327468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.328116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.328394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.328666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.329350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.331297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.361864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a076638f5fc4ab1b70ca28da9f77501', 'request_id': 'req-df9254dd-38c6-436b-896d-fd136871bd91'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:21.374432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] The token cache is being invalidate because project 2a076638f5fc4ab1b70ca28da9f77501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:21.374753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:21.375433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-df9254dd-38c6-436b-896d-fd136871bd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:21.377025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1200/2393] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:21 2022] DELETE /identity/v3/projects/2a076638f5fc4ab1b70ca28da9f77501 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:21.382437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77cae6-a881-4c36-8d1f-ef24348f90b3 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.382724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77cae6-a881-4c36-8d1f-ef24348f90b3 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.383040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77cae6-a881-4c36-8d1f-ef24348f90b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.400471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-9c77cae6-a881-4c36-8d1f-ef24348f90b3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:21.401657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9c77cae6-a881-4c36-8d1f-ef24348f90b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.409555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1201/2394] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:21.423107 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebda1-7c4d-4dc4-a53b-8f8f011f18fe None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.423396 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebda1-7c4d-4dc4-a53b-8f8f011f18fe None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.423705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebda1-7c4d-4dc4-a53b-8f8f011f18fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.441868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-be6ebda1-7c4d-4dc4-a53b-8f8f011f18fe None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:21.443084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-be6ebda1-7c4d-4dc4-a53b-8f8f011f18fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.450981 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1202/2395] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:21.459952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebda1-7c4d-4dc4-a53b-8f8f011f18fe None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.468810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebda1-7c4d-4dc4-a53b-8f8f011f18fe None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.473449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.474085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.474369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.474645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.475413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:21.475727 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.477850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.483937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1194/2396] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:21.487945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.489656 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.493725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1203/2397] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 09:57:21.496790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.502535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e51422-f77b-4ef4-91e6-07ca476d0534 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.506593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d3945-4ac8-426a-8a14-101b6217e760 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.507469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a32501-b338-4059-9f09-71237718083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.508126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a32501-b338-4059-9f09-71237718083e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.508410 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a32501-b338-4059-9f09-71237718083e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.508685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a32501-b338-4059-9f09-71237718083e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.509421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a32501-b338-4059-9f09-71237718083e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.511095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a32501-b338-4059-9f09-71237718083e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.511274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.511906 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.512191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.512478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.513159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.515104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.521217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1195/2398] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:21.524952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a32501-b338-4059-9f09-71237718083e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.534617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a32501-b338-4059-9f09-71237718083e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.540010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.545123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.545123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.545123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.545123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.545123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.555479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1196/2399] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:21.559277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.568716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122bad3-8ce2-4895-9f49-83a7d5bbbb84 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.573446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eae7f3-16c3-4318-a36b-8b8a0764efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.574232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eae7f3-16c3-4318-a36b-8b8a0764efa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.574512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eae7f3-16c3-4318-a36b-8b8a0764efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.574830 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eae7f3-16c3-4318-a36b-8b8a0764efa0 admin admin] PATH_INFO: `/v3/projects/9299e36d43d24731aac673f89d7162f4/users/eb2e9f6b116f41629dff6c490e36bee8/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.588821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eae7f3-16c3-4318-a36b-8b8a0764efa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9299e36d43d24731aac673f89d7162f4, user_id=eb2e9f6b116f41629dff6c490e36bee8, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.591466 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eae7f3-16c3-4318-a36b-8b8a0764efa0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.623141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1204/2400] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/projects => generated 409 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:21.626995 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.685676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ea51-1f55-47ab-b83f-a8b611b49062 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.690318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.691006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.691285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.691555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.692243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.694153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.729710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1197/2401] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:21 2022] PUT /identity/v3/projects/9299e36d43d24731aac673f89d7162f4/users/eb2e9f6b116f41629dff6c490e36bee8/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:21.740065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.740352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.740632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.774094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] MFA Rules not processed for user `eb2e9f6b116f41629dff6c490e36bee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:21.774094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.832023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1205/2402] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/users => generated 305 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:21.832023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.832489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1198/2403] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:21.843364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.845026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:21.845220 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012526-1d98-4969-8a64-fffdd6f89189 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.901297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.901997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.902275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.902547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.903317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.904920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.915701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1206/2404] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:21.919597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.923477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33abbf-ba1d-4149-bec6-ac3911f9f331 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.928707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb48d8c-c8dd-474d-81c1-5f0e2ae4a8fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.929925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ba4e6-aa3f-4bb9-a27b-4b94e2f54be2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.930061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48d8c-c8dd-474d-81c1-5f0e2ae4a8fb service glance] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.930407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48d8c-c8dd-474d-81c1-5f0e2ae4a8fb service glance] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.930688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48d8c-c8dd-474d-81c1-5f0e2ae4a8fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.934641 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.935315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.935599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.935867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.936783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.938998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.940397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb48d8c-c8dd-474d-81c1-5f0e2ae4a8fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.942575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb48d8c-c8dd-474d-81c1-5f0e2ae4a8fb service glance] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:21.949688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1207/2405] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:21.953185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1199/2406] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:21.953664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:21.964318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537826-ecec-4741-aa10-ed962c7d5253 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:21.969092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:21.970114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:21.970399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:21.970673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] PATH_INFO: `/v3/projects/a1f6c499d0da435aa3d67254ac17c5e9/users/6863ad764fa24b77b4cd07a4567cf4ec/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:21.990672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f6c499d0da435aa3d67254ac17c5e9, user_id=6863ad764fa24b77b4cd07a4567cf4ec, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:21.993938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:22.067436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1208/2407] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:21 2022] PUT /identity/v3/projects/a1f6c499d0da435aa3d67254ac17c5e9/users/6863ad764fa24b77b4cd07a4567cf4ec/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:22.078102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ebe9-89f4-4185-b19c-3ae3ba132c00 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:22.078393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ebe9-89f4-4185-b19c-3ae3ba132c00 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:22.078690 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ebe9-89f4-4185-b19c-3ae3ba132c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:22.105796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-3921ebe9-89f4-4185-b19c-3ae3ba132c00 None None] MFA Rules not processed for user `6863ad764fa24b77b4cd07a4567cf4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:22.107260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3921ebe9-89f4-4185-b19c-3ae3ba132c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:22.174693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1200/2408] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:22.179081 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:22.239311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a673a1-c6ea-48c6-a863-b04ca0fa3cbc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:22.244798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:22.245456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:22.245736 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:22.246009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:22.246777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:22.248674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:22.445669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1209/2409] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:22 2022] POST /identity/v3/projects => generated 407 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:22.449651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ebe9-89f4-4185-b19c-3ae3ba132c00 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:22.460336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ebe9-89f4-4185-b19c-3ae3ba132c00 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:22.514010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:22.518058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:22.518058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:22.518058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:22.518058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:22.518058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:22.677677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1201/2410] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:22 2022] POST /identity/v3/users => generated 310 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:22.682105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:22.692234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193967f0-b26c-48ca-b277-062a87e888eb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:22.697306 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:22.697949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:22.698227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:22.698495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:22.699294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:22.700884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:22.711223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1210/2411] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:22.716940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:22.725604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29c06d-61aa-4983-bfe3-583fce2fa1b3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:22.731546 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:22.733266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:22.733266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:22.733266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] PATH_INFO: `/v3/projects/9d24f3822b3546c7bf47ddb383d488f0/users/baec7aa397184b4786551f300a3f635b/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:22.754858 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d24f3822b3546c7bf47ddb383d488f0, user_id=baec7aa397184b4786551f300a3f635b, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:22.758093 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:22.905560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1202/2412] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:22 2022] PUT /identity/v3/projects/9d24f3822b3546c7bf47ddb383d488f0/users/baec7aa397184b4786551f300a3f635b/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:22.909549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:22.919876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83d9f-2370-48a4-9f5c-69bf3f7e719a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:22.973619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13b95-7ed8-48a8-a545-b249101018ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:22.974285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13b95-7ed8-48a8-a545-b249101018ad admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:22.974571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13b95-7ed8-48a8-a545-b249101018ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:22.974878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13b95-7ed8-48a8-a545-b249101018ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:22.975613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b13b95-7ed8-48a8-a545-b249101018ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:22.977710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b13b95-7ed8-48a8-a545-b249101018ad admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:22.987284 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1211/2413] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:22.991448 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:23.002668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93cf27-a9cf-4b02-aa0e-f852f31ed148 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:23.008724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:23.008724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:23.008724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:23.008724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] PATH_INFO: `/v3/projects/9d24f3822b3546c7bf47ddb383d488f0/users/baec7aa397184b4786551f300a3f635b/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:23.010589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d24f3822b3546c7bf47ddb383d488f0, user_id=baec7aa397184b4786551f300a3f635b, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:23.013438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:23.023366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1203/2414] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:22 2022] PUT /identity/v3/projects/9d24f3822b3546c7bf47ddb383d488f0/users/baec7aa397184b4786551f300a3f635b/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:23.034591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d754-8ad3-47bd-b640-90e5054f8dd0 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:23.034929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d754-8ad3-47bd-b640-90e5054f8dd0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:23.035211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d754-8ad3-47bd-b640-90e5054f8dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:23.061812 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3f62d754-8ad3-47bd-b640-90e5054f8dd0 None None] MFA Rules not processed for user `baec7aa397184b4786551f300a3f635b`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:23.063049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3f62d754-8ad3-47bd-b640-90e5054f8dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:23.145194 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1212/2415] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:23.160343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:23.162253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:23.220183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5c162-32db-4830-b4dc-fb6666f662d5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:23.223866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:23.224521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:23.230318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:23.230318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:23.235055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:23.236531 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:23.247010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1204/2416] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:23 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:23.607291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d754-8ad3-47bd-b640-90e5054f8dd0 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:23.616658 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d754-8ad3-47bd-b640-90e5054f8dd0 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:23.620801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013fdad-00fa-4a8c-ab81-6e048d35010d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:23.621425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fdad-00fa-4a8c-ab81-6e048d35010d service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:23.621705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fdad-00fa-4a8c-ab81-6e048d35010d service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:23.621978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013fdad-00fa-4a8c-ab81-6e048d35010d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:23.674814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013fdad-00fa-4a8c-ab81-6e048d35010d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:23.676239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013fdad-00fa-4a8c-ab81-6e048d35010d service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:23.684831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1213/2417] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:49.477306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:49.477306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:49.540275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552ae60-b045-47b8-aee8-26bce7eb25d1 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:49.544890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:49.545790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:49.546068 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:49.546342 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] PATH_INFO: `/v3/users/192826b3ff234501aec7beeed935ab18` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:49.547618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192826b3ff234501aec7beeed935ab18)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:49.549560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:49.775704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192826b3ff234501aec7beeed935ab18'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:49.782258 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192826b3ff234501aec7beeed935ab18'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:49.915654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192826b3ff234501aec7beeed935ab18'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:49.916272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192826b3ff234501aec7beeed935ab18'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:49.928305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192826b3ff234501aec7beeed935ab18'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:49.934669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1205/2418] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:49 2022] DELETE /identity/v3/users/192826b3ff234501aec7beeed935ab18 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:49.939264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:49.939962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:49.939962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:49.956754 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:49.957920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:50.013792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1214/2419] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:50.026541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:50.026541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:50.084239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f5498-657c-4507-8026-7fc663a903b0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:50.088075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:50.088719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:50.089000 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:50.089274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:50.098567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:50.100029 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:50.110066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1206/2420] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:50.221465 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:50.222978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:50.235094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a25c-8179-48ca-a77b-290e9195cca7 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:50.239828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:50.240688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:50.243946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:50.243946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] PATH_INFO: `/v3/users/6863ad764fa24b77b4cd07a4567cf4ec` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:50.243946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6863ad764fa24b77b4cd07a4567cf4ec)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:50.244668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:50.564901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6863ad764fa24b77b4cd07a4567cf4ec'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:50.571791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6863ad764fa24b77b4cd07a4567cf4ec'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:50.572626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6863ad764fa24b77b4cd07a4567cf4ec'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:50.671731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6863ad764fa24b77b4cd07a4567cf4ec'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:50.681704 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:50.683832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:50.689491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9b019e5b-0954-4f31-92d1-13407f73b89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6863ad764fa24b77b4cd07a4567cf4ec'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:50.700193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1215/2421] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:50 2022] DELETE /identity/v3/users/6863ad764fa24b77b4cd07a4567cf4ec => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:50.700762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd414c-6a67-4914-81d2-05f7bb7ddcf0 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:50.702435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:50.702940 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:50.703229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:50.725158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:50.726961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:50.777838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:50.779530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:50.779820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:50.780111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] PATH_INFO: `/v3/projects/be3e9354ba4e4d4bb5f55aa03c9985c5` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:50.781447 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3e9354ba4e4d4bb5f55aa03c9985c5)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:50.783419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:50.791900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1216/2422] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:50.801522 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:50.803520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:50.869848 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2cb39-dbba-40c6-bde8-751e8736b9a5 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:50.873624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ce6a3-aa61-4c80-9208-21e8d8b822c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:50.874274 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce6a3-aa61-4c80-9208-21e8d8b822c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:50.874556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce6a3-aa61-4c80-9208-21e8d8b822c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:50.874871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce6a3-aa61-4c80-9208-21e8d8b822c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:50.884028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ce6a3-aa61-4c80-9208-21e8d8b822c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:50.885491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ce6a3-aa61-4c80-9208-21e8d8b822c6 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:50.895333 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1217/2423] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:57:50.911869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3e9354ba4e4d4bb5f55aa03c9985c5', 'request_id': 'req-531ecd54-6cfa-4557-93d8-c0e12961b062'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:50.917248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3e9354ba4e4d4bb5f55aa03c9985c5', 'request_id': 'req-531ecd54-6cfa-4557-93d8-c0e12961b062'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:51.003096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3e9354ba4e4d4bb5f55aa03c9985c5', 'request_id': 'req-531ecd54-6cfa-4557-93d8-c0e12961b062'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:51.014538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] The token cache is being invalidate because project be3e9354ba4e4d4bb5f55aa03c9985c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:51.014855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:51.015490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-531ecd54-6cfa-4557-93d8-c0e12961b062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:51.017009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1207/2424] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:50 2022] DELETE /identity/v3/projects/be3e9354ba4e4d4bb5f55aa03c9985c5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:51.022697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b900-96bc-4a98-aa3c-f4b6d5fc3a3d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.024064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b900-96bc-4a98-aa3c-f4b6d5fc3a3d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.024353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b900-96bc-4a98-aa3c-f4b6d5fc3a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.041631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f7a8b900-96bc-4a98-aa3c-f4b6d5fc3a3d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:51.042847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f7a8b900-96bc-4a98-aa3c-f4b6d5fc3a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:51.109593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1218/2425] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:51.117522 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e43eb-7240-4719-b64e-30415e2172ec None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.117809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e43eb-7240-4719-b64e-30415e2172ec None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.118083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e43eb-7240-4719-b64e-30415e2172ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.137364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-bf2e43eb-7240-4719-b64e-30415e2172ec None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:51.144248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-bf2e43eb-7240-4719-b64e-30415e2172ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:51.146749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1208/2426] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:51.151120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8b900-96bc-4a98-aa3c-f4b6d5fc3a3d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.160631 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8b900-96bc-4a98-aa3c-f4b6d5fc3a3d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:51.165464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:51.166118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.166397 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.167084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.167495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:51.167798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:51.169401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:51.181880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1219/2427] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:57:51.201879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e43eb-7240-4719-b64e-30415e2172ec None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.220089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e43eb-7240-4719-b64e-30415e2172ec None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:51.225273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:51.225937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.226262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.226511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.227324 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:51.229277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:51.374983 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1209/2428] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:51 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:51.379036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.389630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db5bff-3d87-4bb4-a388-ca2ef605889a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:51.483239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:51.484213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.484494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.484773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.492109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:51.492109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:51.586814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1220/2429] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:51 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:51.591323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.605565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee84283-35f0-4e81-8046-a87c2a10a359 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:51.610504 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:51.611222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.611508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.611783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.612557 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:51.614289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:51.629881 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1210/2430] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:57:51.632538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.643723 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8cd72-ac35-4aec-9fbd-b2a907ef81a2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:51.648707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549e5c4-dffc-486f-83fa-e1792f0b2d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:51.649469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e5c4-dffc-486f-83fa-e1792f0b2d2d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.649823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e5c4-dffc-486f-83fa-e1792f0b2d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.650362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e5c4-dffc-486f-83fa-e1792f0b2d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.651216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549e5c4-dffc-486f-83fa-e1792f0b2d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:51.652953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549e5c4-dffc-486f-83fa-e1792f0b2d2d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:51.664420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1221/2431] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:51.670778 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.684923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfda10-6694-4ebe-9df3-82f1d3370fc9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:51.690866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:51.692113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.692637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.692928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] PATH_INFO: `/v3/projects/523e6933397342978abf83d0831254a8/users/7f1a2cc6fda647709952eaa988d309dc/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.700125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233578-d2d0-4e3f-b29c-4cd6fea49377 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.700510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233578-d2d0-4e3f-b29c-4cd6fea49377 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.700910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233578-d2d0-4e3f-b29c-4cd6fea49377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.708833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523e6933397342978abf83d0831254a8, user_id=7f1a2cc6fda647709952eaa988d309dc, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:51.712359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:51.750356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-bb233578-d2d0-4e3f-b29c-4cd6fea49377 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:51.751603 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-bb233578-d2d0-4e3f-b29c-4cd6fea49377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:51.817181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1222/2432] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:51.847381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1211/2433] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:51 2022] PUT /identity/v3/projects/523e6933397342978abf83d0831254a8/users/7f1a2cc6fda647709952eaa988d309dc/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:51.856547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.856787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.856916 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.857069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.860631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:51.899662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] MFA Rules not processed for user `7f1a2cc6fda647709952eaa988d309dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:51.899662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:51.964557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1223/2434] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:51.970750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4dd4-f0f3-495f-a349-40e9a0e9f492 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:51.974764 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:51.976299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:51.976498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:51.977771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:51.978366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:51.978832 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] PATH_INFO: `/v3/projects/a1f6c499d0da435aa3d67254ac17c5e9` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:51.980176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f6c499d0da435aa3d67254ac17c5e9)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:51.982232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:52.043661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd393c-5020-48d0-a242-6c72c465085f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:52.043661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:52.043661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:52.043661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:52.044367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:52.052181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:52.053606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:52.062855 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1224/2435] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:57:52.065751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:52.065751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:52.113042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f6c499d0da435aa3d67254ac17c5e9', 'request_id': 'req-8cf350a5-60c4-4d47-827a-5b5829b2159a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.121250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f6c499d0da435aa3d67254ac17c5e9', 'request_id': 'req-8cf350a5-60c4-4d47-827a-5b5829b2159a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.157668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68be0c-6bac-4348-8afe-894c35f96cdc service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:52.220651 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f6c499d0da435aa3d67254ac17c5e9', 'request_id': 'req-8cf350a5-60c4-4d47-827a-5b5829b2159a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.230211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:52.231047 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:52.231327 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:52.231757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:52.235172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] The token cache is being invalidate because project a1f6c499d0da435aa3d67254ac17c5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:52.235685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.236683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.242829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1212/2436] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:51 2022] DELETE /identity/v3/projects/a1f6c499d0da435aa3d67254ac17c5e9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:52.243918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:52.245485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:52.299159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:52.305725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:52.309646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1225/2437] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:57:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:57:52.321852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf350a5-60c4-4d47-827a-5b5829b2159a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:52.326929 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:52.327794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:52.328073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:52.328372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] PATH_INFO: `/v3/users/baec7aa397184b4786551f300a3f635b` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:52.329676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=baec7aa397184b4786551f300a3f635b)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:52.331648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:52.569089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baec7aa397184b4786551f300a3f635b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.576930 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baec7aa397184b4786551f300a3f635b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.738597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baec7aa397184b4786551f300a3f635b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.739108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baec7aa397184b4786551f300a3f635b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.754139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c001af30-f0fb-40ee-b276-b77508ba8c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baec7aa397184b4786551f300a3f635b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:52.762256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1213/2438] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:57:52 2022] DELETE /identity/v3/users/baec7aa397184b4786551f300a3f635b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:53.345383 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:53.362143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660014b-f57b-4db1-8242-994450fdf05a service swift] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:53.444365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:53.449774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:53.449774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:53.449774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] PATH_INFO: `/v3/projects/9d24f3822b3546c7bf47ddb383d488f0` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:53.449774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d24f3822b3546c7bf47ddb383d488f0)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:53.449774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:53.591737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d24f3822b3546c7bf47ddb383d488f0', 'request_id': 'req-2a15324c-ddd9-4e01-89c9-696c3829f2d3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:53.597657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d24f3822b3546c7bf47ddb383d488f0', 'request_id': 'req-2a15324c-ddd9-4e01-89c9-696c3829f2d3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:53.679909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d24f3822b3546c7bf47ddb383d488f0', 'request_id': 'req-2a15324c-ddd9-4e01-89c9-696c3829f2d3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:53.693554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] The token cache is being invalidate because project 9d24f3822b3546c7bf47ddb383d488f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:57:53.693953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:53.694977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a15324c-ddd9-4e01-89c9-696c3829f2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:57:53.696645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1226/2439] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:57:53 2022] DELETE /identity/v3/projects/9d24f3822b3546c7bf47ddb383d488f0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:53.703840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795462-2728-4ae7-899b-94a6ecfb837d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:53.704291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795462-2728-4ae7-899b-94a6ecfb837d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:53.704579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795462-2728-4ae7-899b-94a6ecfb837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:53.725663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b0795462-2728-4ae7-899b-94a6ecfb837d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:53.727514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b0795462-2728-4ae7-899b-94a6ecfb837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:53.789403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1214/2440] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:53.796993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0bfd1-8868-45a7-95bd-6fca2dfe7a01 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:53.797361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0bfd1-8868-45a7-95bd-6fca2dfe7a01 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:53.797709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0bfd1-8868-45a7-95bd-6fca2dfe7a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:53.818697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-71e0bfd1-8868-45a7-95bd-6fca2dfe7a01 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:53.819953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-71e0bfd1-8868-45a7-95bd-6fca2dfe7a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:53.828362 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1227/2441] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:53.832114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0795462-2728-4ae7-899b-94a6ecfb837d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:53.842428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0795462-2728-4ae7-899b-94a6ecfb837d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:53.850179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:53.850179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:53.850179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:53.850179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:53.850695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:57:53.851045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:53.853215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:53.871272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1215/2442] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:57:53.872975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0bfd1-8868-45a7-95bd-6fca2dfe7a01 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:53.884431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0bfd1-8868-45a7-95bd-6fca2dfe7a01 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:53.891261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:53.933630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:53.933630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:53.933630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:53.933630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:53.933630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:54.249668 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1228/2443] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:53 2022] POST /identity/v3/projects => generated 373 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:54.250567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:54.262859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2afcd7-f8e4-41bc-b56a-3b5b4661483e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:54.322922 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:54.323779 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:54.324161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:54.324538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:54.325363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:54.327632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:54.472229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1216/2444] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:54 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:57:54.475971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:54.487265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20653d-a392-45ae-856b-b35e0f2c4bba admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:54.492120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:54.492774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:54.493056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:54.493331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:54.494062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:54.495794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:54.508846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1229/2445] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:54.511781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:54.522077 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc46c5-24ce-492e-b123-a60cfbe67118 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:54.527264 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937c7f9-e4ff-4bd6-b551-e2dc6150ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:54.527994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937c7f9-e4ff-4bd6-b551-e2dc6150ed53 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:54.528313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937c7f9-e4ff-4bd6-b551-e2dc6150ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:54.528628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937c7f9-e4ff-4bd6-b551-e2dc6150ed53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:54.529373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937c7f9-e4ff-4bd6-b551-e2dc6150ed53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:54.531157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937c7f9-e4ff-4bd6-b551-e2dc6150ed53 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:54.541951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1217/2446] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:54.546183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:54.565490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757562-4589-4a08-93fb-0be3837493ee admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:54.572398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:54.573714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:54.574310 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:54.574961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] PATH_INFO: `/v3/projects/d32d679fb82e4d2c96165200bf48c9e0/users/819db7a8cc0e4abfa23de8425eef284f/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:54.597434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32d679fb82e4d2c96165200bf48c9e0, user_id=819db7a8cc0e4abfa23de8425eef284f, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:54.603793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:54.725545 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1230/2447] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:54 2022] PUT /identity/v3/projects/d32d679fb82e4d2c96165200bf48c9e0/users/819db7a8cc0e4abfa23de8425eef284f/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:57:54.731340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef81-eb1b-4993-8528-63ba2bf90fd7 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:54.731791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef81-eb1b-4993-8528-63ba2bf90fd7 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:54.732054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef81-eb1b-4993-8528-63ba2bf90fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:54.752837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-41f0ef81-eb1b-4993-8528-63ba2bf90fd7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:54.754174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-41f0ef81-eb1b-4993-8528-63ba2bf90fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:54.815648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1218/2448] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:54.826000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:54.827825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:54.888843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2cd5-3530-40f2-ae77-361fd29d7d1d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:54.895933 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea2eef-c5bf-4f2c-a8ba-96577a7f1b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:54.896602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea2eef-c5bf-4f2c-a8ba-96577a7f1b95 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:54.896892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea2eef-c5bf-4f2c-a8ba-96577a7f1b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:54.897175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea2eef-c5bf-4f2c-a8ba-96577a7f1b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:54.908115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea2eef-c5bf-4f2c-a8ba-96577a7f1b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:54.909813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea2eef-c5bf-4f2c-a8ba-96577a7f1b95 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:54.923432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1231/2449] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:57:55.242327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ae8a-a02e-483a-bf49-49760af54739 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:55.242327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ae8a-a02e-483a-bf49-49760af54739 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:55.242327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ae8a-a02e-483a-bf49-49760af54739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:55.271845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b731ae8a-a02e-483a-bf49-49760af54739 None None] MFA Rules not processed for user `7f1a2cc6fda647709952eaa988d309dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:55.274205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b731ae8a-a02e-483a-bf49-49760af54739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:55.344591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1219/2450] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:57:56.789500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1632-d186-4fd9-89b9-c03e90e473a8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:56.789956 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1632-d186-4fd9-89b9-c03e90e473a8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:56.790276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1632-d186-4fd9-89b9-c03e90e473a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:56.821135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-034a1632-d186-4fd9-89b9-c03e90e473a8 None None] MFA Rules not processed for user `819db7a8cc0e4abfa23de8425eef284f`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:57:56.822407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-034a1632-d186-4fd9-89b9-c03e90e473a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:57:56.924571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1232/2451] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:57:56.925768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ae8a-a02e-483a-bf49-49760af54739 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:56.943689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ae8a-a02e-483a-bf49-49760af54739 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:56.949953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:56.951532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:56.951924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:56.952299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:56.953157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:56.955905 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:57.135847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1220/2452] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:57:56 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:57.136436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1632-d186-4fd9-89b9-c03e90e473a8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:57.155841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1632-d186-4fd9-89b9-c03e90e473a8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:57.274005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:57.274914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:57.275386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:57.275750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:57.276854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:57.279206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:57.449593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1233/2453] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:57:57 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:57:57.453261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:57.464282 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9102cd-1eb6-4d1b-8cd2-b8ef6084aa4f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:57.469068 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:57.469846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:57.470169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:57.470383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:57.471163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:57.472807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:57.487304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1221/2454] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:57.489038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:57.499695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9816a-f822-468b-9c2d-f62956f81854 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:57.504612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:57.505503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:57.505785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:57.506063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] PATH_INFO: `/v3/projects/3656221539db4f2788c8043a5e9e17e5/users/12132f3c5de3490d96baca8bbd956a57/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:57.533356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3656221539db4f2788c8043a5e9e17e5, user_id=12132f3c5de3490d96baca8bbd956a57, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:57.540183 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:57.717929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1234/2455] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:57 2022] PUT /identity/v3/projects/3656221539db4f2788c8043a5e9e17e5/users/12132f3c5de3490d96baca8bbd956a57/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:57:57.721896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:57.731813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2277a7-109a-4b10-a7c6-39685df43d24 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:57.792886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c5480-fa4d-4aee-ac1a-94c1181dc550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:57.793891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5480-fa4d-4aee-ac1a-94c1181dc550 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:57.794331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5480-fa4d-4aee-ac1a-94c1181dc550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:57.794602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c5480-fa4d-4aee-ac1a-94c1181dc550 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:57.795371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c5480-fa4d-4aee-ac1a-94c1181dc550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:57.799919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c5480-fa4d-4aee-ac1a-94c1181dc550 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:57.809609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1222/2456] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:57:57.815037 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:57:57.829965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd65f7-5d6d-4cb6-a335-b70f73eb187e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:57:57.835834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:57:57.847721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:57:57.847721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:57:57.847721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] PATH_INFO: `/v3/projects/3656221539db4f2788c8043a5e9e17e5/users/12132f3c5de3490d96baca8bbd956a57/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:57:57.847721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3656221539db4f2788c8043a5e9e17e5, user_id=12132f3c5de3490d96baca8bbd956a57, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:57:57.847721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:57:57.855246 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1235/2457] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:57:57 2022] PUT /identity/v3/projects/3656221539db4f2788c8043a5e9e17e5/users/12132f3c5de3490d96baca8bbd956a57/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:00.434763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:00.435332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:00.435332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:00.498573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] MFA Rules not processed for user `12132f3c5de3490d96baca8bbd956a57`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:00.499826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:00.587132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1223/2458] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:00.598235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:00.600208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:00.685789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995727f-ad2d-4c60-8130-985c42a92c4d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:00.691175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cf9b-8272-452e-aa7d-f7e95b48698d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:00.691985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cf9b-8272-452e-aa7d-f7e95b48698d service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:00.692369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cf9b-8272-452e-aa7d-f7e95b48698d service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:00.693264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cf9b-8272-452e-aa7d-f7e95b48698d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:00.774090 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cf9b-8272-452e-aa7d-f7e95b48698d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:00.777490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cf9b-8272-452e-aa7d-f7e95b48698d service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:00.793520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1236/2459] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:02.313106 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:02.316177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:02.432825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4e2f-198d-4320-967f-4da68b72dd4a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:02.439456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:02.440748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:02.441196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:02.441676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] PATH_INFO: `/v3/users/eb2e9f6b116f41629dff6c490e36bee8` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:02.443301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2e9f6b116f41629dff6c490e36bee8)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:02.447258 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:02.729997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2e9f6b116f41629dff6c490e36bee8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:02.749698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2e9f6b116f41629dff6c490e36bee8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:02.880895 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2e9f6b116f41629dff6c490e36bee8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:02.881769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2e9f6b116f41629dff6c490e36bee8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:02.904467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2e9f6b116f41629dff6c490e36bee8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:02.933338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1224/2460] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:58:02 2022] DELETE /identity/v3/users/eb2e9f6b116f41629dff6c490e36bee8 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:02.937909 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:02.938484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:02.938484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:02.967774 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:02.969171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:03.107092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1237/2461] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:03.126394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:03.126394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:03.225311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4fd4d-0038-4b7d-a598-457f043eac09 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:03.238860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:03.238860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:03.238860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:03.238860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:03.248874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:03.250648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:03.262359 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1225/2462] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:03.836065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:03.838298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:03.942017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de6487-a123-45ea-88e9-a6e6348d3257 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:03.946516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28603e-7763-4f89-8386-870bdf86ee76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:03.947437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28603e-7763-4f89-8386-870bdf86ee76 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:03.947885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28603e-7763-4f89-8386-870bdf86ee76 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:03.948340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28603e-7763-4f89-8386-870bdf86ee76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:03.950291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4d28603e-7763-4f89-8386-870bdf86ee76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:04.030139 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28603e-7763-4f89-8386-870bdf86ee76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:04.031975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28603e-7763-4f89-8386-870bdf86ee76 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:04.045471 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1238/2463] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:04.387535 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:04.388989 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:04.402340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4286-35a9-4848-a32e-f44571030ee7 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:04.407346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:04.408203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:04.408668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:04.409107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] PATH_INFO: `/v3/projects/9299e36d43d24731aac673f89d7162f4` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:04.410506 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9299e36d43d24731aac673f89d7162f4)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:04.412628 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:04.966065 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9299e36d43d24731aac673f89d7162f4', 'request_id': 'req-4ec3395e-faaa-4821-949d-ba3982dbcfee'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:04.971579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9299e36d43d24731aac673f89d7162f4', 'request_id': 'req-4ec3395e-faaa-4821-949d-ba3982dbcfee'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:05.372205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9299e36d43d24731aac673f89d7162f4', 'request_id': 'req-4ec3395e-faaa-4821-949d-ba3982dbcfee'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:05.384265 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] The token cache is being invalidate because project 9299e36d43d24731aac673f89d7162f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:58:05.384549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:05.385174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4ec3395e-faaa-4821-949d-ba3982dbcfee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:05.386717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1226/2464] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:58:04 2022] DELETE /identity/v3/projects/9299e36d43d24731aac673f89d7162f4 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:05.392646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c614-7553-4ae8-914d-e1b931a16bd8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:05.393227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c614-7553-4ae8-914d-e1b931a16bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:05.393318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c614-7553-4ae8-914d-e1b931a16bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:05.412142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-2185c614-7553-4ae8-914d-e1b931a16bd8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:05.414826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2185c614-7553-4ae8-914d-e1b931a16bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:05.480646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1239/2465] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:05.488255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9dfa6-b73a-4527-9040-4fbc4665896a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:05.490288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9dfa6-b73a-4527-9040-4fbc4665896a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:05.490288 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9dfa6-b73a-4527-9040-4fbc4665896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:05.509769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-99d9dfa6-b73a-4527-9040-4fbc4665896a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:05.511014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-99d9dfa6-b73a-4527-9040-4fbc4665896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:05.518937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1227/2466] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:05.523329 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185c614-7553-4ae8-914d-e1b931a16bd8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:05.534833 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185c614-7553-4ae8-914d-e1b931a16bd8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:05.543951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:05.545096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:05.545612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:05.546168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:05.547623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:58:05.548145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:05.551057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:05.568200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1240/2467] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:58:05.572117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9dfa6-b73a-4527-9040-4fbc4665896a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:05.589160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9dfa6-b73a-4527-9040-4fbc4665896a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:05.598211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:05.598211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:05.598211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:05.598211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:05.598616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:05.598616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:05.711038 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1228/2468] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:58:05 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:58:05.712739 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:05.723974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22336a-481c-4c27-af5b-c96b15a75159 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:05.800553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:05.800817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:05.801044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:05.801238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:05.801957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:05.803962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:06.039279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1241/2469] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:58:05 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:58:06.043069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:06.053941 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39312706-6d75-4e61-b003-fb082a5b5596 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:06.058611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:06.059391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:06.059736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:06.060079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:06.060893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:06.062582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:06.073377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1229/2470] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:58:06.077604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:06.088300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cd3b-49cd-4378-9609-70e73d1218db admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:06.092952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598de7b-c71c-40f9-b18e-1d9ea0cff492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:06.093615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598de7b-c71c-40f9-b18e-1d9ea0cff492 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:06.093913 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598de7b-c71c-40f9-b18e-1d9ea0cff492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:06.094184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598de7b-c71c-40f9-b18e-1d9ea0cff492 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:06.094958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598de7b-c71c-40f9-b18e-1d9ea0cff492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:06.096560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598de7b-c71c-40f9-b18e-1d9ea0cff492 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:06.110555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1242/2471] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:58:06.111717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:06.123209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0985b-d155-42f0-95d6-114984d8fa4d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:06.128498 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:06.129408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:06.129693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:06.129968 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] PATH_INFO: `/v3/projects/72a2645ae7384178968721f298976b76/users/a5cc6304523d4d3ca1d10d7cc18404cb/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:06.146216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a2645ae7384178968721f298976b76, user_id=a5cc6304523d4d3ca1d10d7cc18404cb, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:06.149554 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:06.323276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1230/2472] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:58:06 2022] PUT /identity/v3/projects/72a2645ae7384178968721f298976b76/users/a5cc6304523d4d3ca1d10d7cc18404cb/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:06.333346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddfa6-90c6-485d-9e6c-d1a7e7825dfa None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:06.333636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddfa6-90c6-485d-9e6c-d1a7e7825dfa None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:06.333922 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddfa6-90c6-485d-9e6c-d1a7e7825dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:06.363525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-666ddfa6-90c6-485d-9e6c-d1a7e7825dfa None None] MFA Rules not processed for user `a5cc6304523d4d3ca1d10d7cc18404cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:06.364798 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-666ddfa6-90c6-485d-9e6c-d1a7e7825dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:06.430223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1243/2473] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:06.440081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:06.441863 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:06.502912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1fedf-83f3-47bf-8b04-6b72b8a5ffd5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:06.506759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89969-4979-4e86-b058-fa2134d0f5fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:06.507982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89969-4979-4e86-b058-fa2134d0f5fd service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:06.508259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89969-4979-4e86-b058-fa2134d0f5fd service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:06.508534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89969-4979-4e86-b058-fa2134d0f5fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:06.516755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89969-4979-4e86-b058-fa2134d0f5fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:06.518180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89969-4979-4e86-b058-fa2134d0f5fd service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:06.527792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1231/2474] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:18.739846 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f14f-8828-4059-b139-a1b6089c037a None None] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:18.740669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f14f-8828-4059-b139-a1b6089c037a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:18.740669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4f14f-8828-4059-b139-a1b6089c037a None None] PATH_INFO: `/` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:18.744172 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1244/2475] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:58:18.750057 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861234-5834-497b-be35-9a6a22bae18e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:18.750508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861234-5834-497b-be35-9a6a22bae18e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:18.750611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861234-5834-497b-be35-9a6a22bae18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:18.795974 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2a861234-5834-497b-be35-9a6a22bae18e None None] MFA Rules not processed for user `3d4b284f0c1348bb9baa47b4c531821e`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:18.797320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2a861234-5834-497b-be35-9a6a22bae18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:18.860550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1232/2476] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:18.871868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4f14f-8828-4059-b139-a1b6089c037a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:18.873497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f0d4f14f-8828-4059-b139-a1b6089c037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:18.929064 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4f14f-8828-4059-b139-a1b6089c037a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:18.932680 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2c7d6-d599-4d7f-8c1b-e2ec22451e46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:18.933316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c7d6-d599-4d7f-8c1b-e2ec22451e46 service glance] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:18.933597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c7d6-d599-4d7f-8c1b-e2ec22451e46 service glance] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:18.933872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2c7d6-d599-4d7f-8c1b-e2ec22451e46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:18.943721 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2c7d6-d599-4d7f-8c1b-e2ec22451e46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:18.945142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2c7d6-d599-4d7f-8c1b-e2ec22451e46 service glance] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:18.955476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1245/2477] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:19.181327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4a723-2f8b-4f08-86c8-9a0c37c22e37 None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:19.181646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4a723-2f8b-4f08-86c8-9a0c37c22e37 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:19.181928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4a723-2f8b-4f08-86c8-9a0c37c22e37 None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:19.183795 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1233/2478] 10.222.0.88 () {54 vars in 921 bytes} [Mon Jan 17 09:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 09:58:19.188506 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22bf0-a262-43ee-8cbc-beae0eb6cd3d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:19.188825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22bf0-a262-43ee-8cbc-beae0eb6cd3d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:19.189106 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22bf0-a262-43ee-8cbc-beae0eb6cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:19.206664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c1d22bf0-a262-43ee-8cbc-beae0eb6cd3d None None] MFA Rules not processed for user `4bc44cadca4c4ac3a3264de0a4641437`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:19.207879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c1d22bf0-a262-43ee-8cbc-beae0eb6cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:19.257919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1246/2479] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Jan 17 09:58:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:19.269435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4a723-2f8b-4f08-86c8-9a0c37c22e37 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:19.271166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c8e4a723-2f8b-4f08-86c8-9a0c37c22e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:19.283925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4a723-2f8b-4f08-86c8-9a0c37c22e37 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:19.287385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:19.288529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:19.288804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:19.289101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:19.298747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:19.300152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:19.308527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1234/2480] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:23.357149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d22bf0-a262-43ee-8cbc-beae0eb6cd3d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:23.366632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d22bf0-a262-43ee-8cbc-beae0eb6cd3d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:23.370365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a7b06-4006-412a-a8a4-b4a97272984a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:23.371148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a7b06-4006-412a-a8a4-b4a97272984a service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:23.371285 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a7b06-4006-412a-a8a4-b4a97272984a service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:23.371546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a7b06-4006-412a-a8a4-b4a97272984a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:23.373347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-918a7b06-4006-412a-a8a4-b4a97272984a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:23.387173 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a7b06-4006-412a-a8a4-b4a97272984a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:23.388589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a7b06-4006-412a-a8a4-b4a97272984a service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:23.399154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1247/2481] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:24.315213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:24.324728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfa817-3156-40db-8c05-7606b10712cc service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:24.328592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:24.329233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:24.329517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:24.329790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:24.331652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:24.346188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:24.347923 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:24.362144 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1235/2482] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:30.465584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f92c-dbb0-4cc5-b9c5-fc3707c8050b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:30.466120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f92c-dbb0-4cc5-b9c5-fc3707c8050b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:30.466120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f92c-dbb0-4cc5-b9c5-fc3707c8050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:30.484942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-98d9f92c-dbb0-4cc5-b9c5-fc3707c8050b None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:30.486143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-98d9f92c-dbb0-4cc5-b9c5-fc3707c8050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:30.547422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1248/2483] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:30.560272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:30.561671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:30.628155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e968-2015-43e8-8943-c24986505a47 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:30.633105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49ba2d-00aa-4fa0-b068-c234a048e52b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:30.633753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ba2d-00aa-4fa0-b068-c234a048e52b service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:30.634037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ba2d-00aa-4fa0-b068-c234a048e52b service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:30.634312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ba2d-00aa-4fa0-b068-c234a048e52b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:30.642397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49ba2d-00aa-4fa0-b068-c234a048e52b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:30.644009 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49ba2d-00aa-4fa0-b068-c234a048e52b service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:30.652782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1236/2484] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:58:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:58:31.347279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f92c-dbb0-4cc5-b9c5-fc3707c8050b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:31.412309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f92c-dbb0-4cc5-b9c5-fc3707c8050b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:31.419230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:31.420201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:31.420689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:31.421160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] PATH_INFO: `/v3/users/a5cc6304523d4d3ca1d10d7cc18404cb` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:31.422609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5cc6304523d4d3ca1d10d7cc18404cb)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:31.424643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:31.773750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5cc6304523d4d3ca1d10d7cc18404cb'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:31.780606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5cc6304523d4d3ca1d10d7cc18404cb'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:31.781287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5cc6304523d4d3ca1d10d7cc18404cb'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:31.888555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5cc6304523d4d3ca1d10d7cc18404cb'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:31.902796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5cc6304523d4d3ca1d10d7cc18404cb'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:31.908977 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1249/2485] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:58:31 2022] DELETE /identity/v3/users/a5cc6304523d4d3ca1d10d7cc18404cb => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:58:31.913603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:31.914100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:31.914360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:31.945873 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:31.952972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:32.030976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1237/2486] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:58:32.039495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:32.040937 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:32.105707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f6394-ae4f-4018-b072-d39276fa972e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:32.109571 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbdbff-bd78-42e5-8210-131695bba31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:32.110485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbdbff-bd78-42e5-8210-131695bba31b service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:32.110793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbdbff-bd78-42e5-8210-131695bba31b service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:32.111069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbdbff-bd78-42e5-8210-131695bba31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:32.121350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbdbff-bd78-42e5-8210-131695bba31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:32.138822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbdbff-bd78-42e5-8210-131695bba31b service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:32.138822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1250/2487] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:58:32.684972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:32.684972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:32.684972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034c7bd-d3a2-4a2b-a3c9-dcd5dcee370b None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:32.685232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:32.685232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:32.685232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:32.685232 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] PATH_INFO: `/v3/projects/72a2645ae7384178968721f298976b76` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:32.685573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a2645ae7384178968721f298976b76)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:32.685573 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:33.213957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a2645ae7384178968721f298976b76', 'request_id': 'req-6c9e6268-a341-4730-8b10-3da7567720a8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:33.220337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a2645ae7384178968721f298976b76', 'request_id': 'req-6c9e6268-a341-4730-8b10-3da7567720a8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:33.379097 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a2645ae7384178968721f298976b76', 'request_id': 'req-6c9e6268-a341-4730-8b10-3da7567720a8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:33.392522 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] The token cache is being invalidate because project 72a2645ae7384178968721f298976b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:58:33.392820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:33.393491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6c9e6268-a341-4730-8b10-3da7567720a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:33.422596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1238/2488] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:58:32 2022] DELETE /identity/v3/projects/72a2645ae7384178968721f298976b76 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:33.422777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d0a0-b6b3-428a-bdf8-62b550a681ed None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:33.422777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d0a0-b6b3-428a-bdf8-62b550a681ed None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:33.422777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d0a0-b6b3-428a-bdf8-62b550a681ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:33.422777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5d55d0a0-b6b3-428a-bdf8-62b550a681ed None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:33.422777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5d55d0a0-b6b3-428a-bdf8-62b550a681ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:33.491317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1251/2489] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:33.500181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32df4d7-1500-4d2f-a0e9-e8160f1ca8d0 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:33.506976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32df4d7-1500-4d2f-a0e9-e8160f1ca8d0 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:33.506976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32df4d7-1500-4d2f-a0e9-e8160f1ca8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:33.519893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c32df4d7-1500-4d2f-a0e9-e8160f1ca8d0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:33.521120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c32df4d7-1500-4d2f-a0e9-e8160f1ca8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:33.530843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1239/2490] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:33.534499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55d0a0-b6b3-428a-bdf8-62b550a681ed None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:33.544596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55d0a0-b6b3-428a-bdf8-62b550a681ed None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:33.549710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:33.550373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:33.550666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:33.550983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:33.551791 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:58:33.552114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:33.553744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:33.572965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1252/2491] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:58:33.575735 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32df4d7-1500-4d2f-a0e9-e8160f1ca8d0 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:33.586244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32df4d7-1500-4d2f-a0e9-e8160f1ca8d0 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:33.591404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:33.592079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:33.592369 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:33.592645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:33.593376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:33.595355 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:33.712378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1240/2492] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:58:33 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:58:33.713459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:33.723644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdf622-0610-46a1-a093-77a78ad9e9e1 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:33.795841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:33.796491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:33.796823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:33.797120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:33.797867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:33.799864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:33.981357 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1253/2493] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:58:33 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:58:33.984118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:33.997959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c6ceb-bb6e-4cd7-a382-8351e77e4e80 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:34.003248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:34.004129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:34.004416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:34.004694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:34.005480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:34.007925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:34.024322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1241/2494] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:58:34.025618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:34.036291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ff6d8-fb35-428b-9f84-0304d9c6df10 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:34.043527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59e34f-e324-49a5-a960-badf88c64ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:34.044195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59e34f-e324-49a5-a960-badf88c64ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:34.044613 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59e34f-e324-49a5-a960-badf88c64ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:34.044889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59e34f-e324-49a5-a960-badf88c64ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:34.045691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59e34f-e324-49a5-a960-badf88c64ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:34.047478 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59e34f-e324-49a5-a960-badf88c64ce9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:34.060890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1254/2495] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:58:34.062986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:34.075432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c200-f8b9-4736-97c8-8d308432518c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:34.083408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:34.084462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:34.084737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:34.085062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] PATH_INFO: `/v3/projects/34d672247d114a3f9fe77f21e21d0c16/users/653804a53bc0411a99be81416515390a/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:34.110875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d672247d114a3f9fe77f21e21d0c16, user_id=653804a53bc0411a99be81416515390a, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:34.114331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:34.208398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1242/2496] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:58:34 2022] PUT /identity/v3/projects/34d672247d114a3f9fe77f21e21d0c16/users/653804a53bc0411a99be81416515390a/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:34.219364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:34.219655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:34.219935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:34.247799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] MFA Rules not processed for user `653804a53bc0411a99be81416515390a`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:34.249018 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:34.315447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1255/2497] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:34.325984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:34.327808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:34.421494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3b772-d9ca-4d8a-b40e-004cad85eb29 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:34.426196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:34.426981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:34.427389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:34.428367 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:34.437337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:34.439274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:34.450169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1243/2498] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:36.416417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:36.416417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:36.457605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e06bd-f704-4ffd-a6a9-546f9c7ef477 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:36.465369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5059c54-2651-4ae9-8366-87107422aef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:36.466068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059c54-2651-4ae9-8366-87107422aef8 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:36.466353 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059c54-2651-4ae9-8366-87107422aef8 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:36.466637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059c54-2651-4ae9-8366-87107422aef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:36.468579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d5059c54-2651-4ae9-8366-87107422aef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:36.530136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5059c54-2651-4ae9-8366-87107422aef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:36.531815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5059c54-2651-4ae9-8366-87107422aef8 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:36.542461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1256/2499] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:39.041530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:39.143030 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad27c1-fdb4-4879-8d29-739147fad554 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:39.151600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:39.152698 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:39.153056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:39.153406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] PATH_INFO: `/v3/users/653804a53bc0411a99be81416515390a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:39.154709 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=653804a53bc0411a99be81416515390a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:39.157059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:39.435260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653804a53bc0411a99be81416515390a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:39.442301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653804a53bc0411a99be81416515390a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:39.539640 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653804a53bc0411a99be81416515390a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:39.540246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653804a53bc0411a99be81416515390a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:39.553649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653804a53bc0411a99be81416515390a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:39.560402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1244/2500] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:58:39 2022] DELETE /identity/v3/users/653804a53bc0411a99be81416515390a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:39.564899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:39.565777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:39.566127 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:39.583821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:39.585026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:39.646174 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1257/2501] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:39.656407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:39.657854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:39.721490 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc3083-f3a9-4211-89ba-6e30e9ac37bb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:39.725418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:39.728588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:39.728588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:39.728588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:39.737050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:39.738547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:39.750412 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1245/2502] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:40.487549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:40.488982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:40.505212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34472da-7304-45f4-9f25-d1aab9131f9c None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:40.511042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:40.511984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:40.512280 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:40.512573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] PATH_INFO: `/v3/projects/34d672247d114a3f9fe77f21e21d0c16` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:40.513811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d672247d114a3f9fe77f21e21d0c16)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:40.515885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:41.097003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d672247d114a3f9fe77f21e21d0c16', 'request_id': 'req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:41.102844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d672247d114a3f9fe77f21e21d0c16', 'request_id': 'req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:41.288015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d672247d114a3f9fe77f21e21d0c16', 'request_id': 'req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:41.300114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] The token cache is being invalidate because project 34d672247d114a3f9fe77f21e21d0c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:58:41.300504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:41.301119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:41.303831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1258/2503] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:58:40 2022] DELETE /identity/v3/projects/34d672247d114a3f9fe77f21e21d0c16 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:44.561551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:44.563154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:44.574788 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62071a04-af45-458d-829a-6f17696d927e service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:44.627852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:44.634583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:44.634583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:44.634583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:44.634583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:44.640711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:44.642197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:44.651496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1246/2504] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:44.901312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:44.902665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:44.976982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e79e-0faf-42fe-aa4d-848d1f7f2dd8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:44.982370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:44.983372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:44.983911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:44.984390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] PATH_INFO: `/v3/users/819db7a8cc0e4abfa23de8425eef284f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:44.986110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819db7a8cc0e4abfa23de8425eef284f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:44.988176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:45.191672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819db7a8cc0e4abfa23de8425eef284f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:45.198662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819db7a8cc0e4abfa23de8425eef284f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:45.199445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819db7a8cc0e4abfa23de8425eef284f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:45.293213 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819db7a8cc0e4abfa23de8425eef284f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:45.305835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819db7a8cc0e4abfa23de8425eef284f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:45.314810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1259/2505] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:58:44 2022] DELETE /identity/v3/users/819db7a8cc0e4abfa23de8425eef284f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:45.587261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:45.604632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c504a-f6b6-49aa-aaa3-b1339af756ea service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:45.698323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:45.698998 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:45.699243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:45.699852 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:45.700310 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] PATH_INFO: `/v3/projects/d32d679fb82e4d2c96165200bf48c9e0` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:45.700656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:45.702762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32d679fb82e4d2c96165200bf48c9e0)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:45.704854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:45.785227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1164b-5354-421d-a94a-4b7d88f2b655 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:45.791735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:45.792543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:45.792897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:45.793410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:45.795360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:45.809035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:45.810904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:45.823296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1260/2506] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:58:45.850781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32d679fb82e4d2c96165200bf48c9e0', 'request_id': 'req-38c09e54-3afe-4954-937e-8c45e9a197c7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:45.856479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32d679fb82e4d2c96165200bf48c9e0', 'request_id': 'req-38c09e54-3afe-4954-937e-8c45e9a197c7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:45.993294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32d679fb82e4d2c96165200bf48c9e0', 'request_id': 'req-38c09e54-3afe-4954-937e-8c45e9a197c7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.004594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] The token cache is being invalidate because project d32d679fb82e4d2c96165200bf48c9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:58:46.004883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.005606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.007660 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1247/2507] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:58:45 2022] DELETE /identity/v3/projects/d32d679fb82e4d2c96165200bf48c9e0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:58:46.011575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:46.012958 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:46.025929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790c96-0607-4541-b9f5-8312385f8400 service nova] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:46.081772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:46.082708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:46.083028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:46.083302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] PATH_INFO: `/v3/users/12132f3c5de3490d96baca8bbd956a57` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:46.084602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12132f3c5de3490d96baca8bbd956a57)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:46.086528 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:46.582624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12132f3c5de3490d96baca8bbd956a57'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.589153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12132f3c5de3490d96baca8bbd956a57'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.589842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12132f3c5de3490d96baca8bbd956a57'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.693678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12132f3c5de3490d96baca8bbd956a57'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.706128 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-be3991b4-cb48-420e-abe1-597c78c18f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12132f3c5de3490d96baca8bbd956a57'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:46.712296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1261/2508] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:58:46 2022] DELETE /identity/v3/users/12132f3c5de3490d96baca8bbd956a57 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:47.029071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:47.030627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:47.044585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c09e54-3afe-4954-937e-8c45e9a197c7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:47.102079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:47.106178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.106178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.106178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] PATH_INFO: `/v3/projects/3656221539db4f2788c8043a5e9e17e5` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.106178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3656221539db4f2788c8043a5e9e17e5)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:47.106591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:47.280909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3656221539db4f2788c8043a5e9e17e5', 'request_id': 'req-3ad60abf-47c5-444a-a02f-ed952de73cd0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:47.288762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3656221539db4f2788c8043a5e9e17e5', 'request_id': 'req-3ad60abf-47c5-444a-a02f-ed952de73cd0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:47.463548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3656221539db4f2788c8043a5e9e17e5', 'request_id': 'req-3ad60abf-47c5-444a-a02f-ed952de73cd0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:47.469400 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] The token cache is being invalidate because project 3656221539db4f2788c8043a5e9e17e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:58:47.469692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:47.470489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3ad60abf-47c5-444a-a02f-ed952de73cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:58:47.472087 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1248/2509] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:58:47 2022] DELETE /identity/v3/projects/3656221539db4f2788c8043a5e9e17e5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:47.478399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e865f78-3ce2-450c-b5d9-c19d16a73b63 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.478928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e865f78-3ce2-450c-b5d9-c19d16a73b63 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.479120 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e865f78-3ce2-450c-b5d9-c19d16a73b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.503665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-0e865f78-3ce2-450c-b5d9-c19d16a73b63 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:47.503665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0e865f78-3ce2-450c-b5d9-c19d16a73b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:47.560203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1262/2510] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:47.568859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a9f1-ae8e-421b-9296-52507b731768 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.569168 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a9f1-ae8e-421b-9296-52507b731768 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.569445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a9f1-ae8e-421b-9296-52507b731768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.612218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-6ef2a9f1-ae8e-421b-9296-52507b731768 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:47.613429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6ef2a9f1-ae8e-421b-9296-52507b731768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:47.622327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1249/2511] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:47.626578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e865f78-3ce2-450c-b5d9-c19d16a73b63 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:47.636119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e865f78-3ce2-450c-b5d9-c19d16a73b63 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:47.640607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:47.641241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.641518 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.641788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.642517 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:58:47.642857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:47.644436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:47.655520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1263/2512] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:58:47.659679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a9f1-ae8e-421b-9296-52507b731768 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:47.669480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a9f1-ae8e-421b-9296-52507b731768 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:47.676309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af274f89-7049-4127-a308-fe1c9791ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:47.676309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274f89-7049-4127-a308-fe1c9791ead2 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.676309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274f89-7049-4127-a308-fe1c9791ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.676309 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274f89-7049-4127-a308-fe1c9791ead2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.676678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af274f89-7049-4127-a308-fe1c9791ead2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:47.678792 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af274f89-7049-4127-a308-fe1c9791ead2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:47.780337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1250/2513] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:58:47 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:58:47.784505 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:47.794319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0feea4-b9a4-46b7-b15d-66fb26ce7c5a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:47.847993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:47.848657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.848943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.849761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.850463 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:47.852409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:47.906211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f7d46-190b-4fbe-b2cc-5a7779949ad9 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.906601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f7d46-190b-4fbe-b2cc-5a7779949ad9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.906961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f7d46-190b-4fbe-b2cc-5a7779949ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.925350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-5b2f7d46-190b-4fbe-b2cc-5a7779949ad9 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:47.926517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5b2f7d46-190b-4fbe-b2cc-5a7779949ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:47.976886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1264/2514] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:58:47 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:58:47.979699 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1251/2515] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:58:47.980805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f7d46-190b-4fbe-b2cc-5a7779949ad9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:47.991780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:47.991970 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f7d46-190b-4fbe-b2cc-5a7779949ad9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:47.993411 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:47.996732 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:47.997485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:47.997766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:47.998045 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:47.998812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:48.000420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:48.010343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1252/2516] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:58:48.014406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:48.024381 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cd117-f933-4ea5-9026-e97cb6a23290 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:48.029015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:48.029648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:48.030267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:48.030267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:48.030952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:48.032513 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:48.045822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1253/2517] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:58:48.046892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:48.056250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13e09-62a2-4fe2-8cf2-ee25786ac90d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:48.061035 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8b94-9851-4bd4-84c5-4fd5e7e1273b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:48.061190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:48.061890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:48.062172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:48.062445 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] PATH_INFO: `/v3/projects/fd0fe292f699471184f733fa293a8910/users/0ed721db5a6444a78c4d690be8493356/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:48.066681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc1d57-3508-4f4b-a3d8-ee2489f11305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:48.067502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1d57-3508-4f4b-a3d8-ee2489f11305 service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:48.067892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1d57-3508-4f4b-a3d8-ee2489f11305 service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:48.068184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1d57-3508-4f4b-a3d8-ee2489f11305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:48.076535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc1d57-3508-4f4b-a3d8-ee2489f11305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:48.078104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc1d57-3508-4f4b-a3d8-ee2489f11305 service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:48.078226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0fe292f699471184f733fa293a8910, user_id=0ed721db5a6444a78c4d690be8493356, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:48.081824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:48.086797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1265/2518] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 17 09:58:48.227672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1254/2519] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:58:48 2022] PUT /identity/v3/projects/fd0fe292f699471184f733fa293a8910/users/0ed721db5a6444a78c4d690be8493356/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:58:48.238575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b22b7-aee0-4c17-95cb-5af9bbc0aa94 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:48.238923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b22b7-aee0-4c17-95cb-5af9bbc0aa94 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:48.239200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b22b7-aee0-4c17-95cb-5af9bbc0aa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:48.266356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-066b22b7-aee0-4c17-95cb-5af9bbc0aa94 None None] MFA Rules not processed for user `0ed721db5a6444a78c4d690be8493356`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:48.267582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-066b22b7-aee0-4c17-95cb-5af9bbc0aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:48.329450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1266/2520] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:48.340909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:48.342622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:48.399313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996514e-f943-4c92-881a-53d80d266ea4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:48.403103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:48.403768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:48.404048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:48.404321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:48.413857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:48.414477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:48.423181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1255/2521] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:58:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:58:49.101200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1247-b4eb-47aa-9856-f76b46de29e4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:49.101200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1247-b4eb-47aa-9856-f76b46de29e4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:49.101200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1247-b4eb-47aa-9856-f76b46de29e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:49.114476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-076f1247-b4eb-47aa-9856-f76b46de29e4 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:49.115863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-076f1247-b4eb-47aa-9856-f76b46de29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:49.170767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1267/2522] 10.222.0.88 () {58 vars in 967 bytes} [Mon Jan 17 09:58:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:49.185120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:49.254471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc98c-fca2-45b8-8329-064a0a349291 service glance] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:49.260174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:49.260841 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:49.261128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:49.261406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:49.270889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:49.273094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:49.285487 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1256/2523] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:58:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:58:50.039954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba076f-44b1-4a22-998d-0ae53f535d88 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:50.040281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba076f-44b1-4a22-998d-0ae53f535d88 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:50.044589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba076f-44b1-4a22-998d-0ae53f535d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:50.061972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d4ba076f-44b1-4a22-998d-0ae53f535d88 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:50.063201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d4ba076f-44b1-4a22-998d-0ae53f535d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:50.070771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1268/2524] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:58:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:58:50.082663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:50.093141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463096-1336-4ff5-8058-c18fd44ee227 service swift] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:50.098225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:50.098950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:50.099743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:50.100040 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:50.108722 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:50.110335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:50.119423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1257/2525] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:58:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:58:50.932628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:50.932628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:50.932628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:50.950022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:58:50.951433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:58:50.959321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1269/2526] 10.222.0.88 () {58 vars in 967 bytes} [Mon Jan 17 09:58:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:58:50.981158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:58:50.992382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91a40-6e8d-48a8-8467-146bb4aec143 service swift] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:58:50.997431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ba68d-7f20-4931-8def-43dfa44d7d00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:58:50.998063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba68d-7f20-4931-8def-43dfa44d7d00 service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:58:50.998344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba68d-7f20-4931-8def-43dfa44d7d00 service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:58:50.998618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba68d-7f20-4931-8def-43dfa44d7d00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:58:51.007762 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ba68d-7f20-4931-8def-43dfa44d7d00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:58:51.009399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ba68d-7f20-4931-8def-43dfa44d7d00 service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:58:51.017165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1258/2527] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:58:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:59:01.104682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:01.106229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:01.168912 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eef88b-ab2c-467a-9bc0-67a9d798ab08 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:01.173413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:01.174268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:01.174543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:01.174858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] PATH_INFO: `/v3/users/7f1a2cc6fda647709952eaa988d309dc` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:01.176104 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1a2cc6fda647709952eaa988d309dc)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:01.178086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:01.360198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1a2cc6fda647709952eaa988d309dc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:01.367811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1a2cc6fda647709952eaa988d309dc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:01.374227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1a2cc6fda647709952eaa988d309dc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:01.466349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1a2cc6fda647709952eaa988d309dc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:01.478276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1a2cc6fda647709952eaa988d309dc'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:01.485252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1270/2528] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:59:01 2022] DELETE /identity/v3/users/7f1a2cc6fda647709952eaa988d309dc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:59:01.490518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:01.491266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:01.491266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:01.508687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:01.509878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:01.568170 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1259/2529] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:59:01.577931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:01.579431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:01.640672 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9a7ab-7cbc-44b4-9745-3ebb85c7de55 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:01.645644 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968dd29-d374-45bc-a5e5-9410bf618d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:01.651400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968dd29-d374-45bc-a5e5-9410bf618d92 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:01.651400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968dd29-d374-45bc-a5e5-9410bf618d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:01.651400 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968dd29-d374-45bc-a5e5-9410bf618d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:01.660595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968dd29-d374-45bc-a5e5-9410bf618d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:01.662552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968dd29-d374-45bc-a5e5-9410bf618d92 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:01.674629 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1271/2530] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:59:01.965614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:01.968986 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:01.982163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f5cf6-45bb-47c1-8818-a152fe05e305 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:01.986813 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:01.989177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:01.989909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:01.990196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] PATH_INFO: `/v3/projects/523e6933397342978abf83d0831254a8` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:01.991451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523e6933397342978abf83d0831254a8)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:01.993356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:02.092673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523e6933397342978abf83d0831254a8', 'request_id': 'req-14bc7144-2292-4787-b150-fd927d24d245'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:02.098336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523e6933397342978abf83d0831254a8', 'request_id': 'req-14bc7144-2292-4787-b150-fd927d24d245'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:02.171406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523e6933397342978abf83d0831254a8', 'request_id': 'req-14bc7144-2292-4787-b150-fd927d24d245'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:02.193491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] The token cache is being invalidate because project 523e6933397342978abf83d0831254a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:59:02.193809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:02.194616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-14bc7144-2292-4787-b150-fd927d24d245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:02.196697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1260/2531] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:59:01 2022] DELETE /identity/v3/projects/523e6933397342978abf83d0831254a8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:59:02.203502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3793-6c84-4ea3-9f88-b2a465ad4674 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.204371 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3793-6c84-4ea3-9f88-b2a465ad4674 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.204648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3793-6c84-4ea3-9f88-b2a465ad4674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.222828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-197a3793-6c84-4ea3-9f88-b2a465ad4674 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:02.224678 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-197a3793-6c84-4ea3-9f88-b2a465ad4674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:02.281529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1272/2532] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:02.289976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1ac4-8950-4287-983e-2a6d7c2ca3f5 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.290266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1ac4-8950-4287-983e-2a6d7c2ca3f5 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.290548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1ac4-8950-4287-983e-2a6d7c2ca3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.309610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-754c1ac4-8950-4287-983e-2a6d7c2ca3f5 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:02.310854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-754c1ac4-8950-4287-983e-2a6d7c2ca3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:02.318928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1261/2533] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:02.323057 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3793-6c84-4ea3-9f88-b2a465ad4674 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:02.332843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3793-6c84-4ea3-9f88-b2a465ad4674 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:02.337914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:02.338575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.343526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.343526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.343526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:59:02.343526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:02.343526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:02.354704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1273/2534] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:59:02.359026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c1ac4-8950-4287-983e-2a6d7c2ca3f5 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:02.370626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c1ac4-8950-4287-983e-2a6d7c2ca3f5 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:02.375375 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:02.377809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.377809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.377809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.377809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:02.379286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:02.474833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1262/2535] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:59:02 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:59:02.478891 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:02.488712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ea4c-0b69-49af-a155-15fad74654e9 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:02.554147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:02.554849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.555130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.555401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.556093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:02.557972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:02.674338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1274/2536] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:59:02 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:59:02.680650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:02.693471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc3e28-87b1-4e7b-8fda-84a5e1cd33b1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:02.698248 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:02.698987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.701467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.701467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.701467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:02.701921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:02.712521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1263/2537] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:59:02.716589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:02.727919 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094daf78-7771-4779-a547-c2d70aaf6f96 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:02.732924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2b25c-4a97-4aa9-a7b7-115ee8d4dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:02.733710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2b25c-4a97-4aa9-a7b7-115ee8d4dcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.733993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2b25c-4a97-4aa9-a7b7-115ee8d4dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.734264 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2b25c-4a97-4aa9-a7b7-115ee8d4dcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.735063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2b25c-4a97-4aa9-a7b7-115ee8d4dcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:02.736795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2b25c-4a97-4aa9-a7b7-115ee8d4dcc3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:02.749257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1275/2538] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:59:02.754213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:02.764551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f851-b492-4be9-a0d8-61f819566d25 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:02.769370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:02.770285 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.770611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.771156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] PATH_INFO: `/v3/projects/45bf442b053e4c6bbc0b8d92f848b689/users/9e811dc7816b424c967b77c31c3a49f3/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.785326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bf442b053e4c6bbc0b8d92f848b689, user_id=9e811dc7816b424c967b77c31c3a49f3, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:02.788564 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:02.899633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1264/2539] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:59:02 2022] PUT /identity/v3/projects/45bf442b053e4c6bbc0b8d92f848b689/users/9e811dc7816b424c967b77c31c3a49f3/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:59:02.904737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c84e2-d790-4a46-aaaf-0c76697498d8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:02.905028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c84e2-d790-4a46-aaaf-0c76697498d8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:02.906205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c84e2-d790-4a46-aaaf-0c76697498d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:02.923252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b78c84e2-d790-4a46-aaaf-0c76697498d8 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:02.924502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b78c84e2-d790-4a46-aaaf-0c76697498d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:02.997900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1276/2540] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:03.007163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:03.008843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:03.068081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb6e9a-b71f-4d15-8132-0e0fc65b1ec0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:03.071751 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea15202-7fea-43bf-aef7-fb321ffd819d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:03.072391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea15202-7fea-43bf-aef7-fb321ffd819d service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:03.072673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea15202-7fea-43bf-aef7-fb321ffd819d service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:03.072951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea15202-7fea-43bf-aef7-fb321ffd819d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:03.081835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea15202-7fea-43bf-aef7-fb321ffd819d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:03.083805 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea15202-7fea-43bf-aef7-fb321ffd819d service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:03.093015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1265/2541] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:59:08.710434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:08.710434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:08.710434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:08.747263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] MFA Rules not processed for user `d641be97d52d43f1bd5276e18810ffca`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:08.748516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:08.819916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df5ea-bec2-456b-bd62-c501c2826f93 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:08.820892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df5ea-bec2-456b-bd62-c501c2826f93 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:08.821347 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df5ea-bec2-456b-bd62-c501c2826f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:08.843967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-bb8df5ea-bec2-456b-bd62-c501c2826f93 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:08.845745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-bb8df5ea-bec2-456b-bd62-c501c2826f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:08.870779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1277/2542] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:08.918214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1266/2543] 10.222.0.88 () {58 vars in 967 bytes} [Mon Jan 17 09:59:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:59:08.931959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:08.933480 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:09.013918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751ced-291d-4eda-9222-81d74c0c937c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.014635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751ced-291d-4eda-9222-81d74c0c937c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.015090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751ced-291d-4eda-9222-81d74c0c937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.056899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f3751ced-291d-4eda-9222-81d74c0c937c None None] MFA Rules not processed for user `9e811dc7816b424c967b77c31c3a49f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:09.058931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f3751ced-291d-4eda-9222-81d74c0c937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:09.075636 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77355608-c355-44fa-9419-eba51d4a7db8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.081405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.082200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.082618 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.083008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.095028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.096827 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.107782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1278/2544] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:59:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:59:09.177702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.177953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1267/2545] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:59:09.186249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3751ced-291d-4eda-9222-81d74c0c937c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.187936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c45a-172d-4624-824e-274c93517bf6 service swift] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.191686 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.192455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.192792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.193074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.196051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:09.200172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3751ced-291d-4eda-9222-81d74c0c937c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.206354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.207067 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.207351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.207529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.208163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.208847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.209368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.210827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.226942 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1279/2546] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:59:09.332071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1268/2547] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:59:09 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:59:09.336277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.353819 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d2634-76d3-48e3-a81b-3d68ae6c2fdf service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.420621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.421299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.421580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.421856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.426043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.426043 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.564687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1280/2548] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:59:09 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 09:59:09.568669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.578977 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25af2a-316f-4273-be75-9ae71a3d8bbf admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.583611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.584262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.584547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.584856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.585625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.587254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.598124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1269/2549] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:59:09.602861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.613167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe4e69-97a1-4d48-b494-29b11030dd12 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.618701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.619635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.619908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.620177 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] PATH_INFO: `/v3/projects/095f4290a7004db7883870c31d10eac9/users/15277e5b576d4bbaa11e1d69749103b7/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.634602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095f4290a7004db7883870c31d10eac9, user_id=15277e5b576d4bbaa11e1d69749103b7, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.637255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.765245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.767103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:09.827359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1281/2550] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:59:09 2022] PUT /identity/v3/projects/095f4290a7004db7883870c31d10eac9/users/15277e5b576d4bbaa11e1d69749103b7/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:59:09.831255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.842212 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7972-6a7f-471a-971c-b7f9131e54c4 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.897497 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58950-3f7d-497a-9eda-180776679962 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.902908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.903652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.903954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.904261 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.905003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.906604 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.907881 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f90859-b79c-4c7a-8bc9-782537f458c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.908648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f90859-b79c-4c7a-8bc9-782537f458c0 service placement] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.908993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f90859-b79c-4c7a-8bc9-782537f458c0 service placement] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.909378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f90859-b79c-4c7a-8bc9-782537f458c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.911625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-78f90859-b79c-4c7a-8bc9-782537f458c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:09.920539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1282/2551] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:59:09.921605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:09.924878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f90859-b79c-4c7a-8bc9-782537f458c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.927056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f90859-b79c-4c7a-8bc9-782537f458c0 service placement] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.932642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371c0b5-b10b-4720-8842-989b15bf9fa7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:09.937314 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1270/2552] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 09:59:09.937688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:09.938632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:09.938950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:09.939227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] PATH_INFO: `/v3/projects/095f4290a7004db7883870c31d10eac9/users/15277e5b576d4bbaa11e1d69749103b7/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:09.941228 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=095f4290a7004db7883870c31d10eac9, user_id=15277e5b576d4bbaa11e1d69749103b7, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:09.943971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:09.954781 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1283/2553] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:59:09 2022] PUT /identity/v3/projects/095f4290a7004db7883870c31d10eac9/users/15277e5b576d4bbaa11e1d69749103b7/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:59:17.884502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162a53-61f5-40d8-bcb7-1dc478c1482f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:17.885019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162a53-61f5-40d8-bcb7-1dc478c1482f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:17.885191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162a53-61f5-40d8-bcb7-1dc478c1482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:17.918063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ba162a53-61f5-40d8-bcb7-1dc478c1482f None None] MFA Rules not processed for user `15277e5b576d4bbaa11e1d69749103b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:17.919406 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ba162a53-61f5-40d8-bcb7-1dc478c1482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:17.987909 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1271/2554] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:18.000461 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:18.002278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:18.063749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d692a-2c14-4931-ab41-61a11eff2d2d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:18.067598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:18.068241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:18.068525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:18.068795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:18.122914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:18.124387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:18.133022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1284/2555] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:59:18.420672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:18.420960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:18.421240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:18.439005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:18.440297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:18.497886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1272/2556] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:18.510674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:18.586416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f82ad-f636-4f3e-9b67-86e1d5826839 service glance] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:18.595391 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb795f-7e39-4709-8107-deffe9a63f6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:18.596110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb795f-7e39-4709-8107-deffe9a63f6a service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:18.596394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb795f-7e39-4709-8107-deffe9a63f6a service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:18.596671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb795f-7e39-4709-8107-deffe9a63f6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:18.605825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb795f-7e39-4709-8107-deffe9a63f6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:18.607427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb795f-7e39-4709-8107-deffe9a63f6a service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:18.616416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1285/2557] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:59:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:59:23.826760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:23.829151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:23.918480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240ecd5-4f5d-48f8-b06d-3ef939913b43 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:23.924413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:23.938526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:23.938526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:23.938526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:23.938526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:23.943349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:23.945112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:23.956451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1273/2558] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:59:30.557637 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969badd9-6e24-4109-a044-148828ee16ac None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:30.558055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969badd9-6e24-4109-a044-148828ee16ac None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:30.558191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969badd9-6e24-4109-a044-148828ee16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:30.578864 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-969badd9-6e24-4109-a044-148828ee16ac None None] MFA Rules not processed for user `9e811dc7816b424c967b77c31c3a49f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:30.580060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-969badd9-6e24-4109-a044-148828ee16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:30.587700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1286/2559] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:30.834804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:30.893985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de410a2-8be5-4abd-8b28-08e130747298 service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:30.897802 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:30.898444 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:30.898745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:30.899083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:30.900866 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:30.911209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:30.912641 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:30.920674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1274/2560] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:59:34.509024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:34.509431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:34.509622 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:34.528462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:34.529713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:34.544862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1287/2561] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:34.549414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:34.561570 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608199e1-d4bf-4823-aa0f-3f72feced06a service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:34.567247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d554e-6319-4635-8967-28169e929a46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:34.567931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d554e-6319-4635-8967-28169e929a46 service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:34.568217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d554e-6319-4635-8967-28169e929a46 service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:34.568495 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d554e-6319-4635-8967-28169e929a46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:34.576646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d554e-6319-4635-8967-28169e929a46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:34.578214 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d554e-6319-4635-8967-28169e929a46 service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:34.586630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1275/2562] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 09:59:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 09:59:35.875790 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:35.877300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:35.950910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad869b-6437-453b-a1db-eb1c963c80cb None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:35.955669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:35.956580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:35.956894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:35.957171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] PATH_INFO: `/v3/users/0ed721db5a6444a78c4d690be8493356` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:35.958533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed721db5a6444a78c4d690be8493356)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:35.960548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:36.284797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed721db5a6444a78c4d690be8493356'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:36.292021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed721db5a6444a78c4d690be8493356'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:36.292732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed721db5a6444a78c4d690be8493356'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:36.403202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed721db5a6444a78c4d690be8493356'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:36.416876 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed721db5a6444a78c4d690be8493356'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:36.422820 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1288/2563] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 09:59:35 2022] DELETE /identity/v3/users/0ed721db5a6444a78c4d690be8493356 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:59:36.427312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:36.428256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:36.428256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:36.444838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:36.446085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:36.505344 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1276/2564] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:36.515049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:36.516476 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:36.572997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d954d-b123-414a-acc1-af92868433eb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:36.576495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22af10-38af-4847-8dbf-36432f8341da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:36.577133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22af10-38af-4847-8dbf-36432f8341da service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:36.577413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22af10-38af-4847-8dbf-36432f8341da service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:36.577684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22af10-38af-4847-8dbf-36432f8341da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:36.588319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22af10-38af-4847-8dbf-36432f8341da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:36.589747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22af10-38af-4847-8dbf-36432f8341da service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:36.600412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1289/2565] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:59:37.039621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:37.041154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:37.053517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7b7a2-deba-41cd-800a-8e06bbd1f839 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:37.068562 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:37.069604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.069995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.070322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] PATH_INFO: `/v3/projects/fd0fe292f699471184f733fa293a8910` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.071685 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0fe292f699471184f733fa293a8910)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:37.073817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:37.199261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0fe292f699471184f733fa293a8910', 'request_id': 'req-d432885f-632b-4e23-83be-8aba3f721855'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:37.204491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0fe292f699471184f733fa293a8910', 'request_id': 'req-d432885f-632b-4e23-83be-8aba3f721855'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:37.333918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0fe292f699471184f733fa293a8910', 'request_id': 'req-d432885f-632b-4e23-83be-8aba3f721855'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:37.358646 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] The token cache is being invalidate because project fd0fe292f699471184f733fa293a8910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 09:59:37.359454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:37.360874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d432885f-632b-4e23-83be-8aba3f721855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 09:59:37.363486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1277/2566] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 09:59:37 2022] DELETE /identity/v3/projects/fd0fe292f699471184f733fa293a8910 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 09:59:37.369911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fa3fe-a447-4206-8bc2-a06f141c1a41 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.369911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fa3fe-a447-4206-8bc2-a06f141c1a41 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.369911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fa3fe-a447-4206-8bc2-a06f141c1a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.390525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-a03fa3fe-a447-4206-8bc2-a06f141c1a41 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:37.391896 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a03fa3fe-a447-4206-8bc2-a06f141c1a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:37.451929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1290/2567] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 09:59:37.460426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b349f-8717-4acc-895e-824481ae103d None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.460936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b349f-8717-4acc-895e-824481ae103d None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.461036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b349f-8717-4acc-895e-824481ae103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.479596 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-269b349f-8717-4acc-895e-824481ae103d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:37.480928 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-269b349f-8717-4acc-895e-824481ae103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:37.489463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1278/2568] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:37.493707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fa3fe-a447-4206-8bc2-a06f141c1a41 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:37.504119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fa3fe-a447-4206-8bc2-a06f141c1a41 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:37.508967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:37.509623 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.509904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.510176 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.510946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 09:59:37.511254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:37.512853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:37.525154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1291/2569] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 09:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 09:59:37.529459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b349f-8717-4acc-895e-824481ae103d None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:37.538667 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b349f-8717-4acc-895e-824481ae103d None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:37.543530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:37.544383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.544657 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.545115 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.545827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:37.547755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:37.655884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1279/2570] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 09:59:37 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:59:37.660282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:37.670135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162b93b-c7bd-4e52-8ccf-e5d321d623c2 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:37.728238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:37.728906 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.729190 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.729594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.730304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:37.732340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:37.888853 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1292/2571] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 09:59:37 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 09:59:37.893306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:37.903717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f0484-d843-4f89-b38b-668ce522e1f1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:37.908422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:37.909090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.909374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.909906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.910421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:37.912058 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:37.922906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1280/2572] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 09:59:37.927396 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:37.937294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdc396-ac1f-4ef8-a709-5b8a484e2dfe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:37.943017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2caaca-d37b-4c33-bd77-a0215113b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:37.943681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2caaca-d37b-4c33-bd77-a0215113b1bc admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.944105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2caaca-d37b-4c33-bd77-a0215113b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.944393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2caaca-d37b-4c33-bd77-a0215113b1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.945195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2caaca-d37b-4c33-bd77-a0215113b1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:37.946969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2caaca-d37b-4c33-bd77-a0215113b1bc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:37.957235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1293/2573] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 09:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 09:59:37.961352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:37.971527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132548a-19fd-409b-a0f1-cd0719d0f433 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:37.976416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:37.977377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:37.977659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:37.978105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] PATH_INFO: `/v3/projects/67341b405b724a03b5e6d0f8a2f4c168/users/d4e600470ab34f77ae9d8522b871c914/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:37.993320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67341b405b724a03b5e6d0f8a2f4c168, user_id=d4e600470ab34f77ae9d8522b871c914, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:37.995993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:38.121461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1281/2574] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 09:59:37 2022] PUT /identity/v3/projects/67341b405b724a03b5e6d0f8a2f4c168/users/d4e600470ab34f77ae9d8522b871c914/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 09:59:38.132871 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:38.133153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:38.133450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:38.162551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] MFA Rules not processed for user `d4e600470ab34f77ae9d8522b871c914`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 09:59:38.163868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:38.237702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1294/2575] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 09:59:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 09:59:38.247826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:38.249680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:38.273149 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 09:59:38.274718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:38.328240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddea4e9-f50e-4aa2-a15a-2e0c8d0b58b0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:38.338017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:38.338819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:38.339107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:38.339380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:38.354869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:38.356591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:38.367184 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1282/2576] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 09:59:38.368101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c822dd-31dc-45d8-92e6-35eaf01820d8 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 09:59:38.375099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 09:59:38.375858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 09:59:38.376215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 09:59:38.376579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 09:59:38.379699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 09:59:38.452682 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 09:59:38.454779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 09:59:38.467067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1295/2577] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 09:59:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 10:00:27.837312 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:00:27.838693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:00:27.897771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d41e-e8e0-4b59-8c34-66e125672565 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:00:27.901851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:00:27.902484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:00:27.902789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:00:27.903069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:00:27.904954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:00:27.979760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:00:27.980995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:00:27.993967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1283/2578] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:00:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:00:30.381557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:00:30.383004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:00:30.399185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4c9c-710a-452c-91f4-7fe2c23d032e service nova] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:00:30.405293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1fbd7-8035-45da-b649-ecc7764efa01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:00:30.405959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1fbd7-8035-45da-b649-ecc7764efa01 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:00:30.406243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1fbd7-8035-45da-b649-ecc7764efa01 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:00:30.408422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1fbd7-8035-45da-b649-ecc7764efa01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:00:30.408887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-24c1fbd7-8035-45da-b649-ecc7764efa01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:00:30.421972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1fbd7-8035-45da-b649-ecc7764efa01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:00:30.423656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1fbd7-8035-45da-b649-ecc7764efa01 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:00:30.434234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1296/2579] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:00:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:00:58.921037 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:00:58.980482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449ab0-d4d4-444b-b392-3fe785fd41e3 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:00:58.985833 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:00:58.986772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:00:58.987062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:00:58.987335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] PATH_INFO: `/v3/users/d4e600470ab34f77ae9d8522b871c914` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:00:58.989292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e600470ab34f77ae9d8522b871c914)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:00:58.991497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:00:59.185252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e600470ab34f77ae9d8522b871c914'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:00:59.191924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e600470ab34f77ae9d8522b871c914'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:00:59.256899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e600470ab34f77ae9d8522b871c914'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:00:59.257517 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e600470ab34f77ae9d8522b871c914'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:00:59.269544 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e600470ab34f77ae9d8522b871c914'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:00:59.275492 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1284/2580] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:00:58 2022] DELETE /identity/v3/users/d4e600470ab34f77ae9d8522b871c914 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:00:59.280870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:00:59.281339 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:00:59.281945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:00:59.299096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:00:59.300276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:00:59.356669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1297/2581] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:00:59.367577 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:00:59.368976 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:00:59.423389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cb758-7085-4460-b585-b26e96d5cb98 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:00:59.427126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c63d3-c7c8-4112-bba0-23eb4027578b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:00:59.427710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c63d3-c7c8-4112-bba0-23eb4027578b service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:00:59.427993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c63d3-c7c8-4112-bba0-23eb4027578b service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:00:59.428269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c63d3-c7c8-4112-bba0-23eb4027578b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:00:59.437062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c63d3-c7c8-4112-bba0-23eb4027578b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:00:59.439031 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c63d3-c7c8-4112-bba0-23eb4027578b service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:00:59.448276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1285/2582] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:00:59.921255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:00:59.923349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:00:59.937554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf17a4c-8bf7-4107-bbf9-8e0a7a314263 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:00:59.942312 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:00:59.943196 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:00:59.943482 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:00:59.943755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] PATH_INFO: `/v3/projects/67341b405b724a03b5e6d0f8a2f4c168` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:00:59.944964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67341b405b724a03b5e6d0f8a2f4c168)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:00:59.947065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.108440 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67341b405b724a03b5e6d0f8a2f4c168', 'request_id': 'req-5be93b50-75df-4c28-8aa6-7f15dc6dc199'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:00.114500 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67341b405b724a03b5e6d0f8a2f4c168', 'request_id': 'req-5be93b50-75df-4c28-8aa6-7f15dc6dc199'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:00.148117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67341b405b724a03b5e6d0f8a2f4c168', 'request_id': 'req-5be93b50-75df-4c28-8aa6-7f15dc6dc199'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:00.159626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] The token cache is being invalidate because project 67341b405b724a03b5e6d0f8a2f4c168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:01:00.159915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:00.160663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5be93b50-75df-4c28-8aa6-7f15dc6dc199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:00.162189 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1298/2583] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:00:59 2022] DELETE /identity/v3/projects/67341b405b724a03b5e6d0f8a2f4c168 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:01:00.167738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300e909-ffde-45e0-9e13-7b8c5afca9d3 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.168277 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300e909-ffde-45e0-9e13-7b8c5afca9d3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.168382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300e909-ffde-45e0-9e13-7b8c5afca9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.186054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2300e909-ffde-45e0-9e13-7b8c5afca9d3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:00.187211 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2300e909-ffde-45e0-9e13-7b8c5afca9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:00.248932 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1286/2584] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:00.256328 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65194906-5de1-47ab-9a78-362b25617755 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.256690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65194906-5de1-47ab-9a78-362b25617755 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.257042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65194906-5de1-47ab-9a78-362b25617755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.276881 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-65194906-5de1-47ab-9a78-362b25617755 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:00.278175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-65194906-5de1-47ab-9a78-362b25617755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:00.286818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1299/2585] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:00.291801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300e909-ffde-45e0-9e13-7b8c5afca9d3 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:00.301592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300e909-ffde-45e0-9e13-7b8c5afca9d3 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:00.306254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:00.306946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.307224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.307499 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.308242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:01:00.308548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:00.310183 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.323163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1287/2586] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:01:00.326376 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65194906-5de1-47ab-9a78-362b25617755 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:00.336387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65194906-5de1-47ab-9a78-362b25617755 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:00.343025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:00.343693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.344759 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.345200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.346069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:00.348010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.458100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1300/2587] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:01:00 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:01:00.462455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:00.472231 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ffc6-54f4-412c-8cce-c1ccf26d29a5 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:00.527781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:00.528465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.528745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.529019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.529737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:00.531775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.623089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1288/2588] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:01:00 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:01:00.627426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:00.637771 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5577b-9072-469b-b319-0f15ab66860e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:00.642583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:00.643374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.643698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.643972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.644712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:00.646308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.656239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1301/2589] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:01:00.660721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:00.670590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec6120-b0b0-44b6-87cc-f58ad82a693b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:00.675829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5f785-cbbb-4cca-9570-2518d06fe648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:00.676482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f785-cbbb-4cca-9570-2518d06fe648 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.676759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f785-cbbb-4cca-9570-2518d06fe648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.677032 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f785-cbbb-4cca-9570-2518d06fe648 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.677790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5f785-cbbb-4cca-9570-2518d06fe648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:00.679425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5f785-cbbb-4cca-9570-2518d06fe648 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.689118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1289/2590] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:01:00.696206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:00.706581 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943dbf-54ad-497e-89de-9ac0972fbcdb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:00.711359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:00.712555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.712647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.713010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] PATH_INFO: `/v3/projects/bf9d100b5bb84c7182b94250cf79f641/users/9baf64fc1f934b709cfc9f1b0006b83a/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.730153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9d100b5bb84c7182b94250cf79f641, user_id=9baf64fc1f934b709cfc9f1b0006b83a, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:00.732688 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.794602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1302/2591] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:01:00 2022] PUT /identity/v3/projects/bf9d100b5bb84c7182b94250cf79f641/users/9baf64fc1f934b709cfc9f1b0006b83a/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:01:00.806121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93aa0-66d3-42da-9f53-ad0ff3527ea9 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.806408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93aa0-66d3-42da-9f53-ad0ff3527ea9 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.806683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93aa0-66d3-42da-9f53-ad0ff3527ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.835678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-5ea93aa0-66d3-42da-9f53-ad0ff3527ea9 None None] MFA Rules not processed for user `9baf64fc1f934b709cfc9f1b0006b83a`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:00.837019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5ea93aa0-66d3-42da-9f53-ad0ff3527ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:00.898874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1290/2592] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:00.909938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:00.911753 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:00.967647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf897e-1851-46b9-9088-7e4b73cbac2c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:00.971679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf3065-4484-4fc0-bd26-1a67a42e59dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:00.972311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3065-4484-4fc0-bd26-1a67a42e59dd service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:00.972590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3065-4484-4fc0-bd26-1a67a42e59dd service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:00.972859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3065-4484-4fc0-bd26-1a67a42e59dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:00.980968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf3065-4484-4fc0-bd26-1a67a42e59dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:00.986026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf3065-4484-4fc0-bd26-1a67a42e59dd service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:00.991889 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1303/2593] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:01:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:01:01.017972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea93aa0-66d3-42da-9f53-ad0ff3527ea9 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:01.085152 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea93aa0-66d3-42da-9f53-ad0ff3527ea9 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:01.090304 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:01.091229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:01.091508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:01.091784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] PATH_INFO: `/v3/users/9baf64fc1f934b709cfc9f1b0006b83a` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:01.092996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9baf64fc1f934b709cfc9f1b0006b83a)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:01.095588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:01.373007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9baf64fc1f934b709cfc9f1b0006b83a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:01.381939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9baf64fc1f934b709cfc9f1b0006b83a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:01.526061 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9baf64fc1f934b709cfc9f1b0006b83a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:01.529433 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9baf64fc1f934b709cfc9f1b0006b83a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:01.545979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9baf64fc1f934b709cfc9f1b0006b83a'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:01.553390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1291/2594] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:01:01 2022] DELETE /identity/v3/users/9baf64fc1f934b709cfc9f1b0006b83a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:01:01.561361 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:01.561866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:01.562045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:01.580817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:01.582019 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:01.647779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1304/2595] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:01.657383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:01.658820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:01.719044 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808c17-40a5-47a5-8c77-0067114f3f73 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:01.723422 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e01313-1f3b-4043-b85e-a446687678a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:01.724985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01313-1f3b-4043-b85e-a446687678a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:01.725279 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01313-1f3b-4043-b85e-a446687678a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:01.725702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e01313-1f3b-4043-b85e-a446687678a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:01.737155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e01313-1f3b-4043-b85e-a446687678a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:01.738584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e01313-1f3b-4043-b85e-a446687678a7 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:01.748671 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1292/2596] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:01:02.280454 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:02.283460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:02.323251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ec28f-db86-495a-8230-04a6ea7375fc None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:02.337131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:02.338510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:02.338840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:02.339136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] PATH_INFO: `/v3/projects/bf9d100b5bb84c7182b94250cf79f641` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:02.341060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9d100b5bb84c7182b94250cf79f641)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:02.345289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:02.482200 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9d100b5bb84c7182b94250cf79f641', 'request_id': 'req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:02.488662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9d100b5bb84c7182b94250cf79f641', 'request_id': 'req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:02.559554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9d100b5bb84c7182b94250cf79f641', 'request_id': 'req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:02.572917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] The token cache is being invalidate because project bf9d100b5bb84c7182b94250cf79f641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:01:02.573512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:02.573972 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:02.575583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1305/2597] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:01:02 2022] DELETE /identity/v3/projects/bf9d100b5bb84c7182b94250cf79f641 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:01:06.602824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36c61-dc3a-482a-ac73-19887e685346 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:06.602824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36c61-dc3a-482a-ac73-19887e685346 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:06.602824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36c61-dc3a-482a-ac73-19887e685346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:06.618962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-cfc36c61-dc3a-482a-ac73-19887e685346 None None] MFA Rules not processed for user `15915c83afbe4addbcdd2ede00aa3d57`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:06.620135 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-cfc36c61-dc3a-482a-ac73-19887e685346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:06.672123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1293/2598] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:08.058468 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:08.060000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:08.130551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e90b2f-2741-4564-bfc1-17f6d2f51db5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:08.135436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:08.136311 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:08.136595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:08.136870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] PATH_INFO: `/v3/users/d641be97d52d43f1bd5276e18810ffca` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:08.138108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d641be97d52d43f1bd5276e18810ffca)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:08.140076 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:08.384198 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd641be97d52d43f1bd5276e18810ffca'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:08.391580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd641be97d52d43f1bd5276e18810ffca'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:08.392250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd641be97d52d43f1bd5276e18810ffca'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:08.473447 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd641be97d52d43f1bd5276e18810ffca'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:08.486602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-41528014-6846-49b9-8a3f-d47a66bf9305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd641be97d52d43f1bd5276e18810ffca'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:08.493289 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1306/2599] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:01:08 2022] DELETE /identity/v3/users/d641be97d52d43f1bd5276e18810ffca => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:01:08.732176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36c61-dc3a-482a-ac73-19887e685346 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:08.744385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36c61-dc3a-482a-ac73-19887e685346 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:08.814801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:08.815659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:08.815940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:08.816215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] PATH_INFO: `/v3/projects/4688ab42978643be9b14c64d40460b93` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:08.817459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4688ab42978643be9b14c64d40460b93)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:08.819424 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:08.954643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4688ab42978643be9b14c64d40460b93', 'request_id': 'req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:08.960140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4688ab42978643be9b14c64d40460b93', 'request_id': 'req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:09.038783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4688ab42978643be9b14c64d40460b93', 'request_id': 'req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:09.049954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] The token cache is being invalidate because project 4688ab42978643be9b14c64d40460b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:01:09.050246 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:09.050920 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4975a18f-a99d-4b8c-8f4d-5fe7071eefe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:01:09.052456 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1294/2600] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:01:08 2022] DELETE /identity/v3/projects/4688ab42978643be9b14c64d40460b93 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:01:09.058499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba157a-251c-4fa8-a111-e2ecfc0a0084 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.059004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba157a-251c-4fa8-a111-e2ecfc0a0084 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.059110 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba157a-251c-4fa8-a111-e2ecfc0a0084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.076802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-cfba157a-251c-4fa8-a111-e2ecfc0a0084 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:09.077980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cfba157a-251c-4fa8-a111-e2ecfc0a0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:09.136083 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1307/2601] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:09.145222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1189e-56f1-4495-b99f-1f729e183a18 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.145507 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1189e-56f1-4495-b99f-1f729e183a18 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.145812 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1189e-56f1-4495-b99f-1f729e183a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.164804 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-42b1189e-56f1-4495-b99f-1f729e183a18 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:09.166010 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-42b1189e-56f1-4495-b99f-1f729e183a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:09.174171 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1295/2602] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:01:09.178503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba157a-251c-4fa8-a111-e2ecfc0a0084 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:09.188616 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba157a-251c-4fa8-a111-e2ecfc0a0084 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:09.193321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:09.194063 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.194338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.194607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.195360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:01:09.195660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:09.197230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:09.209475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1308/2603] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 10:01:09.213855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1189e-56f1-4495-b99f-1f729e183a18 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:09.222759 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1189e-56f1-4495-b99f-1f729e183a18 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:09.227370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:09.228005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.228284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.228551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.229240 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:09.231154 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:09.344683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1296/2604] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:01:09 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:01:09.348700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:09.358854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea1aeb-e6f5-4776-92e1-cb07eff59f29 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:09.423254 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:09.423932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.424215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.424487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.425206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:09.427148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:09.537068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1309/2605] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:01:09 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:01:09.541059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:09.553110 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d7573-aa42-40f2-aa91-b0b71235fd70 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:09.558317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:09.559117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.559471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.559815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.560669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:09.562429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:09.573908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1297/2606] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 10:01:09.577967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:09.588402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d241b8-e1b4-42a3-8af7-02b8e9cb52fe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:09.593143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb797a4a-d149-4da5-bde1-4d5f84a8a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:09.593795 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb797a4a-d149-4da5-bde1-4d5f84a8a47a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.594074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb797a4a-d149-4da5-bde1-4d5f84a8a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.594360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb797a4a-d149-4da5-bde1-4d5f84a8a47a admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.595359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb797a4a-d149-4da5-bde1-4d5f84a8a47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:09.596884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb797a4a-d149-4da5-bde1-4d5f84a8a47a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:09.607821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1310/2607] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:01:09.619015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:09.631774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242d29-6528-4ffa-a7c5-c212f76ac20a admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:09.634663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:09.635726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.636027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.636294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] PATH_INFO: `/v3/projects/d877f04e846b491fbdf9e75655bacd33/users/4a5e9ce41413483d86df40bbb8b7a0ad/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.652678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d877f04e846b491fbdf9e75655bacd33, user_id=4a5e9ce41413483d86df40bbb8b7a0ad, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:09.655643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:09.754636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1298/2608] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:01:09 2022] PUT /identity/v3/projects/d877f04e846b491fbdf9e75655bacd33/users/4a5e9ce41413483d86df40bbb8b7a0ad/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:01:09.759877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666553d-8dbb-457a-804e-9983f0209f2b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.760168 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666553d-8dbb-457a-804e-9983f0209f2b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.760472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666553d-8dbb-457a-804e-9983f0209f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.778806 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b666553d-8dbb-457a-804e-9983f0209f2b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:09.780016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b666553d-8dbb-457a-804e-9983f0209f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:09.838525 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1311/2609] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:09.848194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:09.850083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:09.906571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a0cc0-c7b1-4640-9369-d95d5827cc96 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:09.910255 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:09.911003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:09.911286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:09.911561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:09.920744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:09.923954 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:09.931756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1299/2610] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:01:15.617548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825185bd-fca9-4d08-9ec5-04c0dc59f821 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:15.618069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825185bd-fca9-4d08-9ec5-04c0dc59f821 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:15.618202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825185bd-fca9-4d08-9ec5-04c0dc59f821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:15.646574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-825185bd-fca9-4d08-9ec5-04c0dc59f821 None None] MFA Rules not processed for user `4a5e9ce41413483d86df40bbb8b7a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:15.647793 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-825185bd-fca9-4d08-9ec5-04c0dc59f821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:15.721267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1312/2611] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:15.725643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:15.738972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1295792-7d8a-4d47-858a-020af9a271c7 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:15.757612 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:15.769125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:15.769418 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:15.772706 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:15.773622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:15.775623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:15.915598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1300/2612] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:01:15 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:01:15.919689 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825185bd-fca9-4d08-9ec5-04c0dc59f821 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:15.933649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825185bd-fca9-4d08-9ec5-04c0dc59f821 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:15.992050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:15.992737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:15.993025 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:15.993302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:15.994030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:15.996021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:16.091421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1313/2613] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:01:15 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:01:16.095137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:16.105918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686577d2-f9b7-4d64-9b65-8184ed582c80 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:16.111797 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:16.112244 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:16.112559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:16.112857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:16.113563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:16.115340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:16.128239 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1301/2614] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:01:16.132387 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:16.142674 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d2865-e06a-4e82-b35f-61dfe58d7900 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:16.147611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:16.148510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:16.148787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:16.149062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] PATH_INFO: `/v3/projects/1fdd2c3f37b54141b0f1549c0c996719/users/e87c5f1b95c240cd85862539ba7adb64/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:16.183017 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdd2c3f37b54141b0f1549c0c996719, user_id=e87c5f1b95c240cd85862539ba7adb64, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:16.185670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:16.285850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1314/2615] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:01:16 2022] PUT /identity/v3/projects/1fdd2c3f37b54141b0f1549c0c996719/users/e87c5f1b95c240cd85862539ba7adb64/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:01:16.289800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:16.300960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc556a-473c-4de0-bfd8-ae09d357d7eb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:16.363665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b8684-f593-4e4b-a7fa-ed8df5175066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:16.364800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8684-f593-4e4b-a7fa-ed8df5175066 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:16.365085 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8684-f593-4e4b-a7fa-ed8df5175066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:16.365362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8684-f593-4e4b-a7fa-ed8df5175066 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:16.366143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b8684-f593-4e4b-a7fa-ed8df5175066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:16.367819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b8684-f593-4e4b-a7fa-ed8df5175066 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:16.381073 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1302/2616] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:01:16.385907 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:16.396872 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7960a-4353-4112-96d6-08a6e914ab38 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:16.401662 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:16.402579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:16.402990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:16.403293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] PATH_INFO: `/v3/projects/1fdd2c3f37b54141b0f1549c0c996719/users/e87c5f1b95c240cd85862539ba7adb64/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:16.405297 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdd2c3f37b54141b0f1549c0c996719, user_id=e87c5f1b95c240cd85862539ba7adb64, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:16.408975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:16.420187 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1315/2617] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:01:16 2022] PUT /identity/v3/projects/1fdd2c3f37b54141b0f1549c0c996719/users/e87c5f1b95c240cd85862539ba7adb64/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:01:22.501994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:22.502481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:22.502675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:22.531966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] MFA Rules not processed for user `e87c5f1b95c240cd85862539ba7adb64`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:22.533252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:22.635528 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1303/2618] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:22.651294 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:22.653038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:22.730074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd80de-3d6a-46b1-81d9-b563256abb06 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:22.736946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac63132-bc58-4b21-bd95-0c6cbb665e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:22.737654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63132-bc58-4b21-bd95-0c6cbb665e40 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:22.737932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63132-bc58-4b21-bd95-0c6cbb665e40 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:22.738206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63132-bc58-4b21-bd95-0c6cbb665e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:22.796612 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac63132-bc58-4b21-bd95-0c6cbb665e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:22.798223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac63132-bc58-4b21-bd95-0c6cbb665e40 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:22.807402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1316/2619] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:01:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:01:37.853559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:01:37.854966 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:37.922862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502f102-0fca-42ab-9028-6e6edd5462ae None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:01:37.927822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90ae04-69c1-40d2-b139-a0f25f06602c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:01:37.928461 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ae04-69c1-40d2-b139-a0f25f06602c service placement] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:37.928740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ae04-69c1-40d2-b139-a0f25f06602c service placement] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:37.929052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ae04-69c1-40d2-b139-a0f25f06602c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:37.930816 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8c90ae04-69c1-40d2-b139-a0f25f06602c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:37.943125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90ae04-69c1-40d2-b139-a0f25f06602c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:01:37.944738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90ae04-69c1-40d2-b139-a0f25f06602c service placement] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:01:37.954752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1304/2620] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:01:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:01:48.114714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e58a7b-72a7-4ffa-8f2b-ad801889101d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:48.115277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e58a7b-72a7-4ffa-8f2b-ad801889101d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:48.115277 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e58a7b-72a7-4ffa-8f2b-ad801889101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:48.131870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c9e58a7b-72a7-4ffa-8f2b-ad801889101d None None] MFA Rules not processed for user `f230cf14688842a28afa95ad403436b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:48.133163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c9e58a7b-72a7-4ffa-8f2b-ad801889101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:48.184767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1317/2621] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:01:49.612906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35935-cf6a-4f36-862b-0218ec3759c1 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:01:49.613465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35935-cf6a-4f36-862b-0218ec3759c1 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:01:49.613465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35935-cf6a-4f36-862b-0218ec3759c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:01:49.631553 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-24a35935-cf6a-4f36-862b-0218ec3759c1 None None] MFA Rules not processed for user `4a5e9ce41413483d86df40bbb8b7a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:01:49.632748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-24a35935-cf6a-4f36-862b-0218ec3759c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:01:49.642292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1305/2622] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:01:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:02:12.025056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e58a7b-72a7-4ffa-8f2b-ad801889101d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:02:12.079113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e58a7b-72a7-4ffa-8f2b-ad801889101d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:02:12.082633 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:02:12.083299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:02:12.083574 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:02:12.083861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:02:12.092444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:02:12.093849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:02:12.102825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1318/2623] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:02:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:10.396912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b1296-eefd-4e2c-9ae9-04216bf6a0bc None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:10.397454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b1296-eefd-4e2c-9ae9-04216bf6a0bc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:10.397454 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b1296-eefd-4e2c-9ae9-04216bf6a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:10.416081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-640b1296-eefd-4e2c-9ae9-04216bf6a0bc None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:03:10.417869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-640b1296-eefd-4e2c-9ae9-04216bf6a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:10.471084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1306/2624] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 10:03:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:03:10.510485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:10.511949 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:10.577615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a69a30-3b9e-4dad-92b2-6b2b2fab5209 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:10.582599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:10.583266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:10.583550 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:10.583823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:10.592202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:10.593767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:10.601914 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1319/2625] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 10:03:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 10:03:24.545042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b1296-eefd-4e2c-9ae9-04216bf6a0bc None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:24.554102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b1296-eefd-4e2c-9ae9-04216bf6a0bc None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:24.558200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:24.558862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:24.559151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:24.559423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:24.561178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:24.574191 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:24.575668 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:24.586198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1307/2626] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:03:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:25.931434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:25.933433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:25.989221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536609f0-b2fe-4eb4-a479-22e82cb3da7b service swift] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:25.993031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:25.993695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:25.993965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:25.994241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:25.996675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:26.010298 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:26.011755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:26.022762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1320/2627] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:28.607687 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:28.609262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:28.675508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdc8a1-e185-4888-9fcd-6a564d622094 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:28.679869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759baf62-2f0c-4f39-8726-d17853b1c263 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '996e61ee837c4414a6bc725c617cf340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:28.680727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759baf62-2f0c-4f39-8726-d17853b1c263 service glance] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:28.681099 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759baf62-2f0c-4f39-8726-d17853b1c263 service glance] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:28.681623 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759baf62-2f0c-4f39-8726-d17853b1c263 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:28.689236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-759baf62-2f0c-4f39-8726-d17853b1c263 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:28.705741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759baf62-2f0c-4f39-8726-d17853b1c263 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:28.707222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759baf62-2f0c-4f39-8726-d17853b1c263 service glance] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:28.718449 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1308/2628] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:03:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:28.990630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:29.005038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1bce6-4dfa-47d3-bace-fdb8c1e23b99 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:29.019247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:29.019777 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:29.020061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:29.020354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:29.022216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:29.034805 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:29.036235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:29.044487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1321/2629] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:03:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:31.603069 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:31.603584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:31.603707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:31.621357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:03:31.622534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:31.629489 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1309/2630] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Jan 17 10:03:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:03:31.641061 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:31.653359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47039b46-05c5-4125-98ef-67d57dec5f9d service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:31.658351 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:31.659013 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:31.659300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:31.659580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:31.668154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:31.669747 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:31.677602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1322/2631] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 10:03:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 10:03:36.799769 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:36.801181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:36.817111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bace40-1667-4f26-954f-327250fdc584 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:36.823543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:36.824206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:36.824558 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:36.824839 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:36.826681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:36.919423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:37.051169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:37.051169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1310/2632] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:03:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:44.010368 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:44.018257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:44.023424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf094dd-d60f-48a5-82e0-744a07c01458 service swift] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:44.028150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374fb07-f366-43bd-99b5-fd4463a32128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:44.028789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374fb07-f366-43bd-99b5-fd4463a32128 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:44.029066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374fb07-f366-43bd-99b5-fd4463a32128 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:44.029338 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374fb07-f366-43bd-99b5-fd4463a32128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:44.031240 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0374fb07-f366-43bd-99b5-fd4463a32128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:44.050378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374fb07-f366-43bd-99b5-fd4463a32128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:44.050378 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374fb07-f366-43bd-99b5-fd4463a32128 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:44.051572 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1323/2633] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:03:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:46.579776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:46.590712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360a54-9588-4014-a6bd-50beb1a7d12a service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:46.596218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:46.596851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:46.597133 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:46.597408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:46.599210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:46.611311 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:46.612872 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:46.623678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1311/2634] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:03:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:03:47.956255 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4376c43-3256-41bd-9ab7-ca4d9bd5d7d1 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:47.956729 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4376c43-3256-41bd-9ab7-ca4d9bd5d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:47.956837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4376c43-3256-41bd-9ab7-ca4d9bd5d7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:47.974435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b4376c43-3256-41bd-9ab7-ca4d9bd5d7d1 None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:03:47.975766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b4376c43-3256-41bd-9ab7-ca4d9bd5d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:47.983810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1324/2635] 10.222.0.88 () {58 vars in 967 bytes} [Mon Jan 17 10:03:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:03:47.996670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:48.012101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa2917-8810-4294-9966-425606e69a16 service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:48.017105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:48.017740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:48.018024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:48.018299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:48.026632 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:48.028228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:48.036103 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1312/2636] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 10:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 10:03:51.189952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:51.190831 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:51.191275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:51.215369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] MFA Rules not processed for user `5a93d97f27354602aa778cea8d184455`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:03:51.217707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:51.234466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1325/2637] 10.222.0.88 () {58 vars in 967 bytes} [Mon Jan 17 10:03:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:03:51.249883 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:51.261764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb727c-d587-4f3c-a5e7-571e3ccfd405 service swift] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:51.267430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c247c8b8bfe484bb39112144317e59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:51.268076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:51.268364 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:51.268643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:51.278857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:51.280743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:51.289556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1313/2638] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Jan 17 10:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 17 10:03:57.531702 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:57.533270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:57.603965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c93242-6641-4174-b4ee-b93c2bc71ebd None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:57.608963 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:57.609828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:57.610108 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:57.610380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] PATH_INFO: `/v3/users/9e811dc7816b424c967b77c31c3a49f3` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:57.611696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e811dc7816b424c967b77c31c3a49f3)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:57.613645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:57.798693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e811dc7816b424c967b77c31c3a49f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:57.805609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e811dc7816b424c967b77c31c3a49f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:57.806313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e811dc7816b424c967b77c31c3a49f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:57.907638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e811dc7816b424c967b77c31c3a49f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:57.920606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e811dc7816b424c967b77c31c3a49f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:57.926502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1326/2639] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:03:57 2022] DELETE /identity/v3/users/9e811dc7816b424c967b77c31c3a49f3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:03:58.164165 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:58.177635 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d1c09-2e32-42d1-b6fb-778e590f57cf service swift] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:58.232298 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:58.233159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:58.233437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:58.233711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] PATH_INFO: `/v3/projects/45bf442b053e4c6bbc0b8d92f848b689` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:58.234936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bf442b053e4c6bbc0b8d92f848b689)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:58.236862 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:58.395633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bf442b053e4c6bbc0b8d92f848b689', 'request_id': 'req-a00380f0-0d71-44b2-916e-1d8117af6d4c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.398006 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bf442b053e4c6bbc0b8d92f848b689', 'request_id': 'req-a00380f0-0d71-44b2-916e-1d8117af6d4c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.495594 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bf442b053e4c6bbc0b8d92f848b689', 'request_id': 'req-a00380f0-0d71-44b2-916e-1d8117af6d4c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.507241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] The token cache is being invalidate because project 45bf442b053e4c6bbc0b8d92f848b689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:03:58.507530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.508179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.509821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1314/2640] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:03:58 2022] DELETE /identity/v3/projects/45bf442b053e4c6bbc0b8d92f848b689 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:03:58.513732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:58.515178 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:58.534154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e311b-3a4a-404f-968e-8fd7ad36413b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:58.597053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:58.598009 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:58.598521 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:58.599029 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] PATH_INFO: `/v3/users/15277e5b576d4bbaa11e1d69749103b7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:58.600434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15277e5b576d4bbaa11e1d69749103b7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:58.603808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:58.789232 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15277e5b576d4bbaa11e1d69749103b7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.795799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15277e5b576d4bbaa11e1d69749103b7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.796455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15277e5b576d4bbaa11e1d69749103b7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:58.996570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15277e5b576d4bbaa11e1d69749103b7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:59.009555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15277e5b576d4bbaa11e1d69749103b7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:59.015592 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1327/2641] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:03:58 2022] DELETE /identity/v3/users/15277e5b576d4bbaa11e1d69749103b7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:03:59.246379 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:03:59.248308 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:03:59.262592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00380f0-0d71-44b2-916e-1d8117af6d4c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:03:59.317576 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:03:59.318428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:03:59.318710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:03:59.319015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] PATH_INFO: `/v3/projects/095f4290a7004db7883870c31d10eac9` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:03:59.320206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] RBAC: Authorizing `identity:delete_project(project_id=095f4290a7004db7883870c31d10eac9)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:03:59.322881 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:03:59.477799 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095f4290a7004db7883870c31d10eac9', 'request_id': 'req-9f79908c-1983-475d-ada6-746e3ca9329d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:59.483318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095f4290a7004db7883870c31d10eac9', 'request_id': 'req-9f79908c-1983-475d-ada6-746e3ca9329d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:59.556622 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095f4290a7004db7883870c31d10eac9', 'request_id': 'req-9f79908c-1983-475d-ada6-746e3ca9329d'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:59.567610 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] The token cache is being invalidate because project 095f4290a7004db7883870c31d10eac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:03:59.567893 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:59.568510 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:03:59.570023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1315/2642] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:03:59 2022] DELETE /identity/v3/projects/095f4290a7004db7883870c31d10eac9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:04:34.977991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:34.979741 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:35.035720 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ccc0-ee65-4cb0-b25c-5342364ce1a0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:35.085954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:35.086527 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:35.086868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:35.087202 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:35.088985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:35.150535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:35.152002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:35.161757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1328/2643] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:04:39.088848 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:39.090428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:39.104856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79908c-1983-475d-ada6-746e3ca9329d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:39.109864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:39.110790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:39.111076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:39.111351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] PATH_INFO: `/v3/users/f230cf14688842a28afa95ad403436b6` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:39.127713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f230cf14688842a28afa95ad403436b6)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:39.129677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:39.302390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f230cf14688842a28afa95ad403436b6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.309652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f230cf14688842a28afa95ad403436b6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.372583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f230cf14688842a28afa95ad403436b6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.373218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f230cf14688842a28afa95ad403436b6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.386201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-85acac49-a7bc-415e-bbf2-577dcdeafdf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f230cf14688842a28afa95ad403436b6'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.392315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1316/2644] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:04:39 2022] DELETE /identity/v3/users/f230cf14688842a28afa95ad403436b6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:04:39.658346 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:39.667082 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc367a-89c2-4ff9-bb7f-d185e4c245ee service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:39.723718 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:39.724584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:39.724866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:39.725142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] PATH_INFO: `/v3/projects/9d833d073d534e56bcff57aead77b7e7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:39.736514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d833d073d534e56bcff57aead77b7e7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:39.738439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:39.848537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d833d073d534e56bcff57aead77b7e7', 'request_id': 'req-91437dd4-5f7a-4620-a095-7166b883545e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.854691 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d833d073d534e56bcff57aead77b7e7', 'request_id': 'req-91437dd4-5f7a-4620-a095-7166b883545e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.945866 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d833d073d534e56bcff57aead77b7e7', 'request_id': 'req-91437dd4-5f7a-4620-a095-7166b883545e'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.958097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] The token cache is being invalidate because project 9d833d073d534e56bcff57aead77b7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:04:39.958382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.959094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-91437dd4-5f7a-4620-a095-7166b883545e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:39.960724 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1329/2645] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:04:39 2022] DELETE /identity/v3/projects/9d833d073d534e56bcff57aead77b7e7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:04:39.966624 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813cf13-3816-45d2-be60-3d97824f89eb None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:39.966945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813cf13-3816-45d2-be60-3d97824f89eb None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:39.967249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813cf13-3816-45d2-be60-3d97824f89eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:39.985766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f813cf13-3816-45d2-be60-3d97824f89eb None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:39.986993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f813cf13-3816-45d2-be60-3d97824f89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:40.045455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1317/2646] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:40.054002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51799-1775-4b53-a96e-eba178d7f92d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.054296 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51799-1775-4b53-a96e-eba178d7f92d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.054576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51799-1775-4b53-a96e-eba178d7f92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.071946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-64c51799-1775-4b53-a96e-eba178d7f92d None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:40.073138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-64c51799-1775-4b53-a96e-eba178d7f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:40.080952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1330/2647] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:40.086258 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813cf13-3816-45d2-be60-3d97824f89eb None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:40.100321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813cf13-3816-45d2-be60-3d97824f89eb None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:40.106372 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:40.107081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.107366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.107645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.108391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:04:40.108702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:40.110306 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:40.122052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1318/2648] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:04:40.126491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51799-1775-4b53-a96e-eba178d7f92d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:40.135646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51799-1775-4b53-a96e-eba178d7f92d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:40.140405 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:40.141055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.141337 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.141635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.142345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:40.144281 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:40.233884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1331/2649] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:04:40 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:04:40.237731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:40.248382 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c7e-57d8-4fdf-a618-5b071f54c594 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:40.305261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:40.305943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.306222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.306495 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.307245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:40.309169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:40.403416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1319/2650] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:04:40 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:04:40.407287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:40.418212 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaff1d-5b9a-4b1e-9fc7-260260c5184f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:40.423162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:40.423832 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.424116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.424393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.425138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:40.426767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:40.438099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1332/2651] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:04:40.442217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:40.452855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac878-68b5-4c7f-9d94-22f3bc8cc6cb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:40.457974 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921198c0-0dd9-4e48-b444-ad7e245cd194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:40.458638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921198c0-0dd9-4e48-b444-ad7e245cd194 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.458952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921198c0-0dd9-4e48-b444-ad7e245cd194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.459230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921198c0-0dd9-4e48-b444-ad7e245cd194 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.460236 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921198c0-0dd9-4e48-b444-ad7e245cd194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:40.462463 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921198c0-0dd9-4e48-b444-ad7e245cd194 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:40.472868 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1320/2652] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 10:04:40.477690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:40.487971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9a66d-0897-47bf-b66c-671bd3f653c4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:40.493144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:40.494086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.494386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.494704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] PATH_INFO: `/v3/projects/b1090899ce0a49b5b71d37dc6d387f2c/users/13bedd7b70fd46508e661f5fd6ddbed7/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.510235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1090899ce0a49b5b71d37dc6d387f2c, user_id=13bedd7b70fd46508e661f5fd6ddbed7, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:40.512924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:40.578412 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1333/2653] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:04:40 2022] PUT /identity/v3/projects/b1090899ce0a49b5b71d37dc6d387f2c/users/13bedd7b70fd46508e661f5fd6ddbed7/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:04:40.589693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d69f-9b92-4f5f-9d2d-31d134637732 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.589979 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d69f-9b92-4f5f-9d2d-31d134637732 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.590258 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d69f-9b92-4f5f-9d2d-31d134637732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.617053 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8932d69f-9b92-4f5f-9d2d-31d134637732 None None] MFA Rules not processed for user `13bedd7b70fd46508e661f5fd6ddbed7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:40.618268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8932d69f-9b92-4f5f-9d2d-31d134637732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:40.683875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1321/2654] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:40.693605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:40.695869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:40.753705 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ad526-d387-4729-86f2-0619d3f8b584 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:40.758158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:40.758837 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:40.759123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:40.759399 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:40.767986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:40.769424 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:40.779072 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1334/2655] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:04:46.303508 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18da8-cc95-467e-a907-6fe63b052191 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:46.304617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18da8-cc95-467e-a907-6fe63b052191 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:46.304617 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18da8-cc95-467e-a907-6fe63b052191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:46.324616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-caa18da8-cc95-467e-a907-6fe63b052191 None None] MFA Rules not processed for user `4a5e9ce41413483d86df40bbb8b7a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:46.325821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-caa18da8-cc95-467e-a907-6fe63b052191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:46.393016 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1322/2656] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:46.710485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:46.711954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:46.768214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852f43-fcc5-4d3a-a879-4406cb504ecb service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:46.771918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9332a-2731-453a-8294-9f292c26ffbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:46.772543 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9332a-2731-453a-8294-9f292c26ffbd service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:46.773318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9332a-2731-453a-8294-9f292c26ffbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:46.773595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9332a-2731-453a-8294-9f292c26ffbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:46.775407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4be9332a-2731-453a-8294-9f292c26ffbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:46.784839 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9332a-2731-453a-8294-9f292c26ffbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:46.786260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9332a-2731-453a-8294-9f292c26ffbd service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:46.794787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1335/2657] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:04:50.078540 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811ab9-71e5-4e96-a5a2-6a4f2ee503de None None] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:50.079156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811ab9-71e5-4e96-a5a2-6a4f2ee503de None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:50.079156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811ab9-71e5-4e96-a5a2-6a4f2ee503de None None] PATH_INFO: `/` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:50.081169 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1323/2658] 10.222.0.88 () {54 vars in 960 bytes} [Mon Jan 17 10:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 17 10:04:50.086409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428d06a-df55-410a-a0b1-2fe1f78545d6 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:50.087053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428d06a-df55-410a-a0b1-2fe1f78545d6 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:50.087053 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428d06a-df55-410a-a0b1-2fe1f78545d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:50.140852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6428d06a-df55-410a-a0b1-2fe1f78545d6 None None] MFA Rules not processed for user `64fd2d1e8d054688a294bcc718449005`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:50.142184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6428d06a-df55-410a-a0b1-2fe1f78545d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:50.224253 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1336/2659] 10.222.0.88 () {58 vars in 1057 bytes} [Mon Jan 17 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:50.235027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811ab9-71e5-4e96-a5a2-6a4f2ee503de None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:50.249471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811ab9-71e5-4e96-a5a2-6a4f2ee503de None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:50.255462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292883-e7ef-454b-b56a-a16241bc8908 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:50.256215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292883-e7ef-454b-b56a-a16241bc8908 service placement] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:50.256618 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292883-e7ef-454b-b56a-a16241bc8908 service placement] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:50.257560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292883-e7ef-454b-b56a-a16241bc8908 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:50.259702 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-78292883-e7ef-454b-b56a-a16241bc8908 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:50.272174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78292883-e7ef-454b-b56a-a16241bc8908 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:50.274354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78292883-e7ef-454b-b56a-a16241bc8908 service placement] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:50.284276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1324/2660] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:04:53.117561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428d06a-df55-410a-a0b1-2fe1f78545d6 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:53.182502 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428d06a-df55-410a-a0b1-2fe1f78545d6 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:53.187565 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:53.188462 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:53.188748 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:53.189022 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] PATH_INFO: `/v3/users/13bedd7b70fd46508e661f5fd6ddbed7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:53.190363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13bedd7b70fd46508e661f5fd6ddbed7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:53.192515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:53.540408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13bedd7b70fd46508e661f5fd6ddbed7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:53.547666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13bedd7b70fd46508e661f5fd6ddbed7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:53.548894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13bedd7b70fd46508e661f5fd6ddbed7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:53.660161 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13bedd7b70fd46508e661f5fd6ddbed7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:53.674591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13bedd7b70fd46508e661f5fd6ddbed7'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:53.681203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1337/2661] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:04:53 2022] DELETE /identity/v3/users/13bedd7b70fd46508e661f5fd6ddbed7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:04:53.685902 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:53.686439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:53.686439 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:53.705363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:53.706753 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:53.782249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1325/2662] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:53.793733 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:53.795135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:53.856236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e431b2b-972f-4f1f-ac15-1f6e3842b97a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:53.860250 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d89dc-3b78-4f79-9c57-934524fb4013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:53.860900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d89dc-3b78-4f79-9c57-934524fb4013 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:53.861182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d89dc-3b78-4f79-9c57-934524fb4013 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:53.861488 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d89dc-3b78-4f79-9c57-934524fb4013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:53.873208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d89dc-3b78-4f79-9c57-934524fb4013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:53.874638 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d89dc-3b78-4f79-9c57-934524fb4013 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:53.884991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1338/2663] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:04:54.353860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:54.362032 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:54.369708 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5479a-2504-4618-b84e-0bd8741ac504 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:54.374414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:54.375313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:54.375589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:54.375859 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] PATH_INFO: `/v3/projects/b1090899ce0a49b5b71d37dc6d387f2c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:54.377339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1090899ce0a49b5b71d37dc6d387f2c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:54.379302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:54.495695 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1090899ce0a49b5b71d37dc6d387f2c', 'request_id': 'req-a8a728d8-08af-4cde-aaad-df234badddfe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:54.501503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1090899ce0a49b5b71d37dc6d387f2c', 'request_id': 'req-a8a728d8-08af-4cde-aaad-df234badddfe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:54.587352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1090899ce0a49b5b71d37dc6d387f2c', 'request_id': 'req-a8a728d8-08af-4cde-aaad-df234badddfe'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:54.602943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] The token cache is being invalidate because project b1090899ce0a49b5b71d37dc6d387f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:04:54.602943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:54.602943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a8a728d8-08af-4cde-aaad-df234badddfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:04:54.604026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1326/2664] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:04:54 2022] DELETE /identity/v3/projects/b1090899ce0a49b5b71d37dc6d387f2c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:04:54.609598 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e619000-b31e-4f8a-a7e9-e6177adcf2d0 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:54.610133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e619000-b31e-4f8a-a7e9-e6177adcf2d0 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:54.610133 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e619000-b31e-4f8a-a7e9-e6177adcf2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:54.630209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-1e619000-b31e-4f8a-a7e9-e6177adcf2d0 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:54.631472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1e619000-b31e-4f8a-a7e9-e6177adcf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:54.693974 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1339/2665] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:54.702346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c65db-04fb-4fec-8539-1e88f2f6aeea None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:54.703399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c65db-04fb-4fec-8539-1e88f2f6aeea None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:54.703399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c65db-04fb-4fec-8539-1e88f2f6aeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:54.722389 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-285c65db-04fb-4fec-8539-1e88f2f6aeea None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:54.729738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-285c65db-04fb-4fec-8539-1e88f2f6aeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:54.732146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1327/2666] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:54.736244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e619000-b31e-4f8a-a7e9-e6177adcf2d0 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:54.746020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e619000-b31e-4f8a-a7e9-e6177adcf2d0 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:54.750858 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:54.751522 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:54.751803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:54.752078 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:54.752890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:04:54.753201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:54.754836 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:54.767809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1340/2667] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:04:54.773204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c65db-04fb-4fec-8539-1e88f2f6aeea None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:54.782292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c65db-04fb-4fec-8539-1e88f2f6aeea None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:54.786938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:54.787586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:54.787891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:54.788229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:54.789021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:54.790846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:54.924081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1328/2668] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:04:54 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:04:54.928203 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:54.938282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc556b0-b866-4d07-a926-cc483357cdab admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.004181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.004767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.005179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.005594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.006520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.009135 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:55.095935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1341/2669] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:04:54 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:04:55.100174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:55.113225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c595f5e-34b1-4802-838e-bda4ac033374 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.119796 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.120761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.121180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.121551 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.122397 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.124164 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:55.135303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1329/2670] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 10:04:55.139700 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:55.151219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae1d2f-448c-4f62-a1ef-a7e826b7c4ac admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.156201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cd6c2-91f5-436a-9d79-ddad69f89b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.156874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cd6c2-91f5-436a-9d79-ddad69f89b85 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.157155 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cd6c2-91f5-436a-9d79-ddad69f89b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.157435 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cd6c2-91f5-436a-9d79-ddad69f89b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.158181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cd6c2-91f5-436a-9d79-ddad69f89b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.159817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cd6c2-91f5-436a-9d79-ddad69f89b85 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:55.170256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1342/2671] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:04:55.174482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:55.187004 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d3c1-c469-4915-ac8e-6f3a724489cb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.192887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.193910 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.194916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.195361 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] PATH_INFO: `/v3/projects/b77cb60d582544b18cd6899198143025/users/5d4fc969310b479890e62ec028c50ab8/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.210673 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77cb60d582544b18cd6899198143025, user_id=5d4fc969310b479890e62ec028c50ab8, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.213356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:55.292599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1330/2672] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:04:55 2022] PUT /identity/v3/projects/b77cb60d582544b18cd6899198143025/users/5d4fc969310b479890e62ec028c50ab8/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:04:55.304441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087b2f-b7c8-4d9b-9e31-b2b56987f436 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.304729 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087b2f-b7c8-4d9b-9e31-b2b56987f436 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.305004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087b2f-b7c8-4d9b-9e31-b2b56987f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.332191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-47087b2f-b7c8-4d9b-9e31-b2b56987f436 None None] MFA Rules not processed for user `5d4fc969310b479890e62ec028c50ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:55.333398 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-47087b2f-b7c8-4d9b-9e31-b2b56987f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:55.406033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1343/2673] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:55.410399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:55.481334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b8c0-2bd8-41d9-9ea4-3686f98c8dad admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.486505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.487223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.488225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.488225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.488526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.490378 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:55.621500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1331/2674] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:04:55 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:04:55.622755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087b2f-b7c8-4d9b-9e31-b2b56987f436 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:55.634645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087b2f-b7c8-4d9b-9e31-b2b56987f436 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.716209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.716209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.716209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.716209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.716621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.716621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:55.843278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1344/2675] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:04:55 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:04:55.847488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:55.861225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762f276-55cc-4384-a0ad-7a54fb28375d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.866854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.867644 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.868013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.868365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.869376 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.871335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:55.883681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1332/2676] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:04:55.888137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:55.900890 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179846e-ea3f-46bf-8ad9-5566e9cc6fd1 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:55.905823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:55.906719 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:55.907030 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:55.907304 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] PATH_INFO: `/v3/projects/02dd60916e7b438db77090ee28cfc560/users/99b65a7fc976403791cdfab44ce0f032/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:55.923092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dd60916e7b438db77090ee28cfc560, user_id=99b65a7fc976403791cdfab44ce0f032, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:55.925659 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:56.065800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1345/2677] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:04:55 2022] PUT /identity/v3/projects/02dd60916e7b438db77090ee28cfc560/users/99b65a7fc976403791cdfab44ce0f032/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:04:56.070327 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:56.080931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f4c88-9b3b-4db9-8b7f-e05586967a0d admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:56.144147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bfe44-44e3-4dfd-a2a1-b1021cc05465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:56.145122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bfe44-44e3-4dfd-a2a1-b1021cc05465 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:56.145404 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bfe44-44e3-4dfd-a2a1-b1021cc05465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:56.145678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bfe44-44e3-4dfd-a2a1-b1021cc05465 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:56.146429 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bfe44-44e3-4dfd-a2a1-b1021cc05465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:56.148210 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bfe44-44e3-4dfd-a2a1-b1021cc05465 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:56.159303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1333/2678] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:04:56.164504 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:56.174635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa71ce-9f51-4d74-b842-cff6fdfd637d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:56.180639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:56.181695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:56.182060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:56.182409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] PATH_INFO: `/v3/projects/02dd60916e7b438db77090ee28cfc560/users/99b65a7fc976403791cdfab44ce0f032/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:56.184620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dd60916e7b438db77090ee28cfc560, user_id=99b65a7fc976403791cdfab44ce0f032, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:56.187394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:56.198807 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1346/2679] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:04:56 2022] PUT /identity/v3/projects/02dd60916e7b438db77090ee28cfc560/users/99b65a7fc976403791cdfab44ce0f032/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:04:56.209157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:56.209371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:56.209665 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:56.240460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] MFA Rules not processed for user `99b65a7fc976403791cdfab44ce0f032`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:04:56.241960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:56.311295 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1334/2680] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:04:56.322758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:56.324490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:56.382789 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057034-7a53-47c0-a4b9-47964de6e668 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:56.389568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:56.390238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:56.390553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:56.390905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:56.401529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:56.403848 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:56.415883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1347/2681] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:04:56.593199 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:56.594821 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:56.608043 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf064-af91-4bb3-8c31-a5a65f8b692e None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:56.611694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:56.612380 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:56.612663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:56.612939 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:56.675128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:56.676574 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:56.686571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1335/2682] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:04:58.699859 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:04:58.712503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:58.765137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571a77-3602-4973-84a0-7a35c8ce39e3 service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:04:58.774144 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34053b-4127-4b61-877b-2fdb39a5825a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:04:58.774712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34053b-4127-4b61-877b-2fdb39a5825a service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:04:58.775109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34053b-4127-4b61-877b-2fdb39a5825a service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:04:58.775290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34053b-4127-4b61-877b-2fdb39a5825a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:04:58.777156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5a34053b-4127-4b61-877b-2fdb39a5825a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:04:58.850214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34053b-4127-4b61-877b-2fdb39a5825a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:04:58.851928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34053b-4127-4b61-877b-2fdb39a5825a service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:04:58.862927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1348/2683] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:02.237990 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:02.252875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947bda-dfe5-493a-8647-a91726e36686 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:02.257888 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:02.258837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:02.259120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:02.259393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] PATH_INFO: `/v3/users/5d4fc969310b479890e62ec028c50ab8` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:02.260691 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4fc969310b479890e62ec028c50ab8)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:02.262631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:02.514123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4fc969310b479890e62ec028c50ab8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:02.521621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4fc969310b479890e62ec028c50ab8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:02.619555 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4fc969310b479890e62ec028c50ab8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:02.620346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4fc969310b479890e62ec028c50ab8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:02.647101 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4fc969310b479890e62ec028c50ab8'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:02.654637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1336/2684] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:02 2022] DELETE /identity/v3/users/5d4fc969310b479890e62ec028c50ab8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:02.662808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:02.663214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:02.663514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:02.687708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:02.689111 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:02.799498 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1349/2685] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:02.817864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:02.820339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:02.923946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11521b7-80e5-4645-9050-796a5104d36f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:02.929519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:02.930391 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:02.930746 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:02.931175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:02.943142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:02.945231 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:02.957100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1337/2686] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 10:05:03.605796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:03.607986 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:03.624850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df8683-e17f-49db-b146-2efe24a83984 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:03.629883 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:03.630948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:03.631229 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:03.632003 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] PATH_INFO: `/v3/projects/b77cb60d582544b18cd6899198143025` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:03.633314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77cb60d582544b18cd6899198143025)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:03.635712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:03.664071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:03.665001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:03.680712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e7d83-bb50-4013-822a-9fe61d75a66c service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:03.685957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:03.686874 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:03.687158 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:03.687681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] PATH_INFO: `/v3/users/15915c83afbe4addbcdd2ede00aa3d57` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:03.688627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15915c83afbe4addbcdd2ede00aa3d57)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:03.690601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:03.834049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77cb60d582544b18cd6899198143025', 'request_id': 'req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:03.839749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77cb60d582544b18cd6899198143025', 'request_id': 'req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.002535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77cb60d582544b18cd6899198143025', 'request_id': 'req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.016134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] The token cache is being invalidate because project b77cb60d582544b18cd6899198143025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:04.030828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.030828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.030828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1350/2687] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:03 2022] DELETE /identity/v3/projects/b77cb60d582544b18cd6899198143025 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:04.030828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:04.030828 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:04.091516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda939e3-dc20-4dd5-9d6a-e4eb3d43a0c5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:04.097321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:04.098224 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:04.098512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:04.098818 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] PATH_INFO: `/v3/users/99b65a7fc976403791cdfab44ce0f032` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:04.100047 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b65a7fc976403791cdfab44ce0f032)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:04.102667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:04.251436 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15915c83afbe4addbcdd2ede00aa3d57'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.259075 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15915c83afbe4addbcdd2ede00aa3d57'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.366891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15915c83afbe4addbcdd2ede00aa3d57'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.367578 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15915c83afbe4addbcdd2ede00aa3d57'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.381120 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15915c83afbe4addbcdd2ede00aa3d57'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.387994 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1338/2688] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:03 2022] DELETE /identity/v3/users/15915c83afbe4addbcdd2ede00aa3d57 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:04.415562 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b65a7fc976403791cdfab44ce0f032'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.423464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b65a7fc976403791cdfab44ce0f032'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.424215 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b65a7fc976403791cdfab44ce0f032'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.507236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b65a7fc976403791cdfab44ce0f032'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.521563 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b65a7fc976403791cdfab44ce0f032'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:04.528870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1351/2689] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:04 2022] DELETE /identity/v3/users/99b65a7fc976403791cdfab44ce0f032 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:04.768114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:04.769606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:04.845100 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd4e3-f9ee-4ef4-92d7-e08876115980 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:04.905716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:04.906611 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:04.906934 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:04.907213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] PATH_INFO: `/v3/projects/e71a78f8eb2445168288dcdc86badcab` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:04.908428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71a78f8eb2445168288dcdc86badcab)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:04.910326 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.019716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71a78f8eb2445168288dcdc86badcab', 'request_id': 'req-5042f020-c2ce-4574-8e5e-b1b7c987b781'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.029520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71a78f8eb2445168288dcdc86badcab', 'request_id': 'req-5042f020-c2ce-4574-8e5e-b1b7c987b781'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.089893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.091560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.108472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f81d-3d67-4575-92c7-be6d31a8d1b4 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.111343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71a78f8eb2445168288dcdc86badcab', 'request_id': 'req-5042f020-c2ce-4574-8e5e-b1b7c987b781'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.134835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] The token cache is being invalidate because project e71a78f8eb2445168288dcdc86badcab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:05.134835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.134835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-5042f020-c2ce-4574-8e5e-b1b7c987b781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.134835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1339/2690] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:04 2022] DELETE /identity/v3/projects/e71a78f8eb2445168288dcdc86badcab => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:05.139357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb0ec2-1ac0-458f-abf9-d47ac6418568 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.139683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb0ec2-1ac0-458f-abf9-d47ac6418568 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.139964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb0ec2-1ac0-458f-abf9-d47ac6418568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.160215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-4beb0ec2-1ac0-458f-abf9-d47ac6418568 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:05.161961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4beb0ec2-1ac0-458f-abf9-d47ac6418568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.168621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.169519 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.169801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.170075 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] PATH_INFO: `/v3/projects/02dd60916e7b438db77090ee28cfc560` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.171369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02dd60916e7b438db77090ee28cfc560)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.173266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.173820 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1340/2691] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:05.183116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7fb2b-3688-4af5-8fe2-3b63c6888118 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.183479 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7fb2b-3688-4af5-8fe2-3b63c6888118 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.183675 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7fb2b-3688-4af5-8fe2-3b63c6888118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.203420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-51d7fb2b-3688-4af5-8fe2-3b63c6888118 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:05.204605 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-51d7fb2b-3688-4af5-8fe2-3b63c6888118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.212726 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1341/2692] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:05.217315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7fb2b-3688-4af5-8fe2-3b63c6888118 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.226815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7fb2b-3688-4af5-8fe2-3b63c6888118 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.231741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.232377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.232658 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.232927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.233659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:05:05.233962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.235602 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.247887 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1342/2693] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 10:05:05.252131 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.262148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874ab8-d4b8-4a10-9f54-fbe162ef3981 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.266771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.267890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.267890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.268201 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.268613 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.270533 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.362413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dd60916e7b438db77090ee28cfc560', 'request_id': 'req-672c6f7d-f452-4828-9fba-b9fb1abf18c8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.370354 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dd60916e7b438db77090ee28cfc560', 'request_id': 'req-672c6f7d-f452-4828-9fba-b9fb1abf18c8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.380363 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1343/2694] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:05.384559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.443592 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff785-9f01-487c-8731-e875425cb590 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.448250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.448906 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.449190 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.449466 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.450162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.452092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.459693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dd60916e7b438db77090ee28cfc560', 'request_id': 'req-672c6f7d-f452-4828-9fba-b9fb1abf18c8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.470886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] The token cache is being invalidate because project 02dd60916e7b438db77090ee28cfc560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:05.473978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.473978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-672c6f7d-f452-4828-9fba-b9fb1abf18c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:05.473978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1352/2695] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:05 2022] DELETE /identity/v3/projects/02dd60916e7b438db77090ee28cfc560 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:05.481143 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8affe1c-04a4-4fd0-bb25-d6d127ebe9a2 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.481429 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8affe1c-04a4-4fd0-bb25-d6d127ebe9a2 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.481707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8affe1c-04a4-4fd0-bb25-d6d127ebe9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.500300 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c8affe1c-04a4-4fd0-bb25-d6d127ebe9a2 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:05.501496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c8affe1c-04a4-4fd0-bb25-d6d127ebe9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.509286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1353/2696] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:05.516884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7ed5f-2eaf-4dfc-b35d-a8c2116e41af None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.517197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7ed5f-2eaf-4dfc-b35d-a8c2116e41af None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.517445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7ed5f-2eaf-4dfc-b35d-a8c2116e41af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.537293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-3ac7ed5f-2eaf-4dfc-b35d-a8c2116e41af None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:05.538428 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3ac7ed5f-2eaf-4dfc-b35d-a8c2116e41af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.546993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1354/2697] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:05.551042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7ed5f-2eaf-4dfc-b35d-a8c2116e41af None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.561157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7ed5f-2eaf-4dfc-b35d-a8c2116e41af None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.565951 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.566595 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.566925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.567227 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.568015 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:05:05.568319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.569929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.581928 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1355/2698] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 10:05:05.589952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.602911 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d8d54-988b-4917-9e58-8b55fb02b786 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.607923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.608579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.608861 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.609138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.609844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.611780 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.625484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1344/2699] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:05.629301 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.632011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.644693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb631-2637-4170-a7b8-3e44a7cb3ec1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.649819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.650470 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.650771 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.651048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.651781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.653366 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.664476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1345/2700] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 10:05:05.668485 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.678458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b096b3-e28f-4759-b61d-b3e1e6babf9c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.683413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.684076 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.684354 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.684626 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.685365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.687046 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.697869 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1346/2701] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 10:05:05.701843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.712486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153980e-ff55-4033-92c7-e5a7e0821591 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.717233 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb012cd-9f24-4a6e-a2be-830169e21113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.718128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb012cd-9f24-4a6e-a2be-830169e21113 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.718430 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb012cd-9f24-4a6e-a2be-830169e21113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.718683 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb012cd-9f24-4a6e-a2be-830169e21113 admin admin] PATH_INFO: `/v3/projects/0994434bfd544042994eaaee67e270e1/users/ccf30cb554184f5d9232700873dd7b86/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.723847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1356/2702] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:05.724752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.737202 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb012cd-9f24-4a6e-a2be-830169e21113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0994434bfd544042994eaaee67e270e1, user_id=ccf30cb554184f5d9232700873dd7b86, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.740094 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb012cd-9f24-4a6e-a2be-830169e21113 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.787450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9a78-6c70-4569-ba2e-2a7ef427e526 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:05.793070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:05.793738 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.794159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.794439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.795181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:05.797142 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:05.848050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1347/2703] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:05 2022] PUT /identity/v3/projects/0994434bfd544042994eaaee67e270e1/users/ccf30cb554184f5d9232700873dd7b86/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:05.863847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:05.864137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:05.864415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:05.890860 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] MFA Rules not processed for user `ccf30cb554184f5d9232700873dd7b86`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:05.892079 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.954068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1357/2704] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:05.955162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.956815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1348/2705] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:05.968163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:05.969550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:05.969671 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8311bf-0e0b-400e-adf0-5956da8f2ae3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:06.025349 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:06.026021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.026307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.026585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:06.027395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:06.028984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:06.038966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1358/2706] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:06.041237 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa41a-e73b-4b7c-8d33-ea8d4ef9c3dc None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:06.043305 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:06.047092 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:06.047745 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.048125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.048403 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:06.056633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:06.058205 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9686d-06d4-4cd0-a3f7-85ad27faf693 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:06.058340 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:06.065038 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b87ea-9ff0-4e7c-9ff0-d26fe57ab18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:06.065710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b87ea-9ff0-4e7c-9ff0-d26fe57ab18a admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.065992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b87ea-9ff0-4e7c-9ff0-d26fe57ab18a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.066265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b87ea-9ff0-4e7c-9ff0-d26fe57ab18a admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:06.067124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b87ea-9ff0-4e7c-9ff0-d26fe57ab18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:06.069236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b87ea-9ff0-4e7c-9ff0-d26fe57ab18a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:06.078118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1349/2707] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 10:05:06.079936 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1359/2708] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:06.085269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:06.096901 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91656b7-c50c-42c1-baed-76d9b9e22041 service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:06.101107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:06.101981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.102258 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.102532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] PATH_INFO: `/v3/projects/0907e543b3024416a782024a705978c8/users/ebc705bdccbc4321a469d2f5125af42b/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:06.120565 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0907e543b3024416a782024a705978c8, user_id=ebc705bdccbc4321a469d2f5125af42b, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:06.123426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:06.218648 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1350/2709] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:06 2022] PUT /identity/v3/projects/0907e543b3024416a782024a705978c8/users/ebc705bdccbc4321a469d2f5125af42b/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:06.231032 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d94d-f450-45e2-9c7a-5ceb0cb12e41 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.231585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d94d-f450-45e2-9c7a-5ceb0cb12e41 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.231585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d94d-f450-45e2-9c7a-5ceb0cb12e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:06.261485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-0044d94d-f450-45e2-9c7a-5ceb0cb12e41 None None] MFA Rules not processed for user `ebc705bdccbc4321a469d2f5125af42b`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:06.262708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-0044d94d-f450-45e2-9c7a-5ceb0cb12e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:06.327326 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1360/2710] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:06.338319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:06.340034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:06.397620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49b99-0fa8-445e-8e37-0f2851a50494 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:06.403124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cca8fd-85fa-413e-9ad6-0b55d73059cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:06.403763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cca8fd-85fa-413e-9ad6-0b55d73059cc service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.404042 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cca8fd-85fa-413e-9ad6-0b55d73059cc service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.404313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cca8fd-85fa-413e-9ad6-0b55d73059cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:06.413782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cca8fd-85fa-413e-9ad6-0b55d73059cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:06.415267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cca8fd-85fa-413e-9ad6-0b55d73059cc service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:06.424276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1351/2711] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:06.444856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d94d-f450-45e2-9c7a-5ceb0cb12e41 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:06.505687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d94d-f450-45e2-9c7a-5ceb0cb12e41 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:06.511237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:06.512100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.512410 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.512687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] PATH_INFO: `/v3/users/ebc705bdccbc4321a469d2f5125af42b` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:06.513899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc705bdccbc4321a469d2f5125af42b)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:06.516005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:06.850799 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc705bdccbc4321a469d2f5125af42b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:06.857538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc705bdccbc4321a469d2f5125af42b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:06.858193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc705bdccbc4321a469d2f5125af42b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:06.967973 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc705bdccbc4321a469d2f5125af42b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:06.981794 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc705bdccbc4321a469d2f5125af42b'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:06.988282 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1361/2712] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:06 2022] DELETE /identity/v3/users/ebc705bdccbc4321a469d2f5125af42b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:06.994225 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:06.994973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:06.995254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:07.013845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:07.015124 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:07.077188 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1352/2713] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:07.093453 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:07.094994 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:07.158966 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea0477-5425-4d45-a554-60e30b9a84b6 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:07.162589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac313ea-cf5f-4de8-956d-05b31664f138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:07.163268 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac313ea-cf5f-4de8-956d-05b31664f138 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:07.163573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac313ea-cf5f-4de8-956d-05b31664f138 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:07.163852 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac313ea-cf5f-4de8-956d-05b31664f138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:07.173265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac313ea-cf5f-4de8-956d-05b31664f138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:07.185787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac313ea-cf5f-4de8-956d-05b31664f138 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:07.185787 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1362/2714] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:07.643938 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:07.646249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:07.660662 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126ae64-68f2-4e07-b4b7-d3d52767203c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:07.667916 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:07.669178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:07.669178 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:07.669481 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] PATH_INFO: `/v3/projects/0907e543b3024416a782024a705978c8` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:07.670719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0907e543b3024416a782024a705978c8)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:07.672638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:07.862226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0907e543b3024416a782024a705978c8', 'request_id': 'req-4434cc29-98e5-48fd-aad7-c6d368ed3600'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:07.867524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0907e543b3024416a782024a705978c8', 'request_id': 'req-4434cc29-98e5-48fd-aad7-c6d368ed3600'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:08.019139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0907e543b3024416a782024a705978c8', 'request_id': 'req-4434cc29-98e5-48fd-aad7-c6d368ed3600'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:08.031218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] The token cache is being invalidate because project 0907e543b3024416a782024a705978c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:08.031503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:08.032151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-4434cc29-98e5-48fd-aad7-c6d368ed3600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:08.033645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1353/2715] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:07 2022] DELETE /identity/v3/projects/0907e543b3024416a782024a705978c8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:08.039857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef9d2-9a81-4201-9531-1c98c824016a None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.040370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef9d2-9a81-4201-9531-1c98c824016a None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.040464 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef9d2-9a81-4201-9531-1c98c824016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.057850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-06eef9d2-9a81-4201-9531-1c98c824016a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:08.059068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-06eef9d2-9a81-4201-9531-1c98c824016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:08.125138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1363/2716] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:08.131981 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7daa1-a7ba-4019-b1e3-e5ee892fda21 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.132457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7daa1-a7ba-4019-b1e3-e5ee892fda21 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.132793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7daa1-a7ba-4019-b1e3-e5ee892fda21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.155992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c7d7daa1-a7ba-4019-b1e3-e5ee892fda21 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:08.157234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c7d7daa1-a7ba-4019-b1e3-e5ee892fda21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:08.167143 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1354/2717] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:08.171699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eef9d2-9a81-4201-9531-1c98c824016a None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:08.182990 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eef9d2-9a81-4201-9531-1c98c824016a None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:08.190147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:08.190147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.190704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.191012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.192418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:05:08.192867 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:08.195102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:08.210352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1364/2718] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:05:08.211750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7daa1-a7ba-4019-b1e3-e5ee892fda21 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:08.220867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7daa1-a7ba-4019-b1e3-e5ee892fda21 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:08.228321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:08.228321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.228321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.228321 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.230674 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:08.230944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:08.403414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1355/2719] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:08 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:08.407621 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:08.419611 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97197abe-664a-46ed-b24e-7b5f2c03a310 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:08.477716 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:08.478568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.478886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.479164 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.479886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:08.482234 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:08.604374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1365/2720] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:08 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:08.608496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:08.619760 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c40ec-67c5-4b71-b4cc-aba24cf89299 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:08.624334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:08.624967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.625303 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.625581 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.626318 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:08.627948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:08.639343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1356/2721] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:08.652023 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:08.668365 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1718fd-9f81-482c-9aac-a2f64a3823ac admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:08.675160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7baa2-49d0-4de2-81af-8e651471e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:08.676209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7baa2-49d0-4de2-81af-8e651471e605 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.676920 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7baa2-49d0-4de2-81af-8e651471e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.677084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7baa2-49d0-4de2-81af-8e651471e605 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.678279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7baa2-49d0-4de2-81af-8e651471e605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:08.681158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7baa2-49d0-4de2-81af-8e651471e605 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:08.698549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1366/2722] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:08.702627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:08.713679 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037864d6-23d8-4120-bf06-f5e351364e19 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:08.718385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:08.719322 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.719606 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.719878 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] PATH_INFO: `/v3/projects/01bca34fffd14373b152bce1b4c5633f/users/8d2e2ed7bd094e33ad8bbb43674a4fd9/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.736518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bca34fffd14373b152bce1b4c5633f, user_id=8d2e2ed7bd094e33ad8bbb43674a4fd9, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:08.739374 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:08.876560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1357/2723] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:08 2022] PUT /identity/v3/projects/01bca34fffd14373b152bce1b4c5633f/users/8d2e2ed7bd094e33ad8bbb43674a4fd9/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:08.888266 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:08.888555 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:08.888842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:08.916131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] MFA Rules not processed for user `8d2e2ed7bd094e33ad8bbb43674a4fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:08.917345 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:08.981894 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1367/2724] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:08.991269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:08.992952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:09.048810 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cc678-63f3-4292-918f-a4feab6ed105 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:09.052629 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:09.053864 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:09.054149 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:09.054419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:09.062898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:09.064339 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:09.073811 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1358/2725] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:10.624094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:10.628364 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:10.707564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c446689-57c7-4d7b-8046-bdc44bc07b80 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:10.713704 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54669567-161d-4aea-96a2-722717bb9bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:10.714380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54669567-161d-4aea-96a2-722717bb9bbd service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:10.714666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54669567-161d-4aea-96a2-722717bb9bbd service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:10.714978 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54669567-161d-4aea-96a2-722717bb9bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:10.717167 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-54669567-161d-4aea-96a2-722717bb9bbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:10.730892 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54669567-161d-4aea-96a2-722717bb9bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:10.732507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54669567-161d-4aea-96a2-722717bb9bbd service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:10.744710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1368/2726] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:16.721529 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:16.723388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:16.793993 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5bef-eadf-44e7-beb9-f662ac1783fb service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:16.798835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:16.799711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:16.800001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:16.800275 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] PATH_INFO: `/v3/users/ccf30cb554184f5d9232700873dd7b86` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:16.801505 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf30cb554184f5d9232700873dd7b86)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:16.803484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:17.107541 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf30cb554184f5d9232700873dd7b86'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:17.117519 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf30cb554184f5d9232700873dd7b86'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:17.219175 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf30cb554184f5d9232700873dd7b86'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:17.219877 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf30cb554184f5d9232700873dd7b86'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:17.241213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf30cb554184f5d9232700873dd7b86'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:17.242084 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1359/2727] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:16 2022] DELETE /identity/v3/users/ccf30cb554184f5d9232700873dd7b86 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:17.247675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:17.248769 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:17.249044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:17.267767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:17.269218 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:17.330291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1369/2728] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:17.341985 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:17.343408 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:17.403724 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ada76-3508-4d32-a9f5-a93bce13570b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:17.407811 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a2746-d6c5-45d1-92bc-2e01f71bcf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:17.408462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2746-d6c5-45d1-92bc-2e01f71bcf71 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:17.408742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2746-d6c5-45d1-92bc-2e01f71bcf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:17.409011 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a2746-d6c5-45d1-92bc-2e01f71bcf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:17.419350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a2746-d6c5-45d1-92bc-2e01f71bcf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:17.420926 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a2746-d6c5-45d1-92bc-2e01f71bcf71 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:17.432252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1360/2729] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:18.723510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:18.725181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:18.739875 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b056d-6deb-4cdc-a58a-aeed8fea5d2b None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:18.745195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:18.746291 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:18.746971 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:18.747606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] PATH_INFO: `/v3/projects/0994434bfd544042994eaaee67e270e1` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:18.749171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0994434bfd544042994eaaee67e270e1)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:18.751148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:18.952841 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0994434bfd544042994eaaee67e270e1', 'request_id': 'req-55c8b623-80b2-4a93-9d1d-77f996e325b6'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:18.959717 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0994434bfd544042994eaaee67e270e1', 'request_id': 'req-55c8b623-80b2-4a93-9d1d-77f996e325b6'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:19.071776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0994434bfd544042994eaaee67e270e1', 'request_id': 'req-55c8b623-80b2-4a93-9d1d-77f996e325b6'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:19.084918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] The token cache is being invalidate because project 0994434bfd544042994eaaee67e270e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:19.085188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:19.095823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-55c8b623-80b2-4a93-9d1d-77f996e325b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:19.095823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1370/2730] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:18 2022] DELETE /identity/v3/projects/0994434bfd544042994eaaee67e270e1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:19.097435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b5a77-75dd-4494-aa23-79a77c9733c3 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.097958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b5a77-75dd-4494-aa23-79a77c9733c3 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.098186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b5a77-75dd-4494-aa23-79a77c9733c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.121398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-811b5a77-75dd-4494-aa23-79a77c9733c3 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:19.122809 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-811b5a77-75dd-4494-aa23-79a77c9733c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:19.192163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1361/2731] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:19.201445 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dab4a-e59c-4386-851b-b5c7ea91d324 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.201735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dab4a-e59c-4386-851b-b5c7ea91d324 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.202207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dab4a-e59c-4386-851b-b5c7ea91d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.221452 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b88dab4a-e59c-4386-851b-b5c7ea91d324 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:19.222868 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b88dab4a-e59c-4386-851b-b5c7ea91d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:19.232286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1371/2732] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:19.236469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b5a77-75dd-4494-aa23-79a77c9733c3 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:19.257023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b5a77-75dd-4494-aa23-79a77c9733c3 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:19.257023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:19.257023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.257023 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.257591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.257591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:05:19.257591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:19.257591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:19.269590 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1362/2733] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:05:19.274341 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dab4a-e59c-4386-851b-b5c7ea91d324 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:19.287863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dab4a-e59c-4386-851b-b5c7ea91d324 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:19.293646 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:19.296153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.296153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.296153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.296153 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:19.298193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:19.410823 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1372/2734] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:19 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:19.419443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:19.431676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c768ac5-e640-4951-b742-f4f88629bd45 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:19.504136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:19.504835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.505116 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.505405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.506125 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:19.508226 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:19.641784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1363/2735] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:19 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:19.646059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:19.656734 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b78b-5e75-471d-9168-98338e67c5d0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:19.661515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:19.662803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.663113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.663390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.664125 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:19.665722 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:19.676585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1373/2736] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:19.681360 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:19.691141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7bb4-39e4-4001-a3de-ea1f17c2a405 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:19.697978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca721-abd2-47e5-9a82-af94bd893eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:19.698663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca721-abd2-47e5-9a82-af94bd893eec admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.698948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca721-abd2-47e5-9a82-af94bd893eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.699217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca721-abd2-47e5-9a82-af94bd893eec admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.699951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfca721-abd2-47e5-9a82-af94bd893eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:19.701543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfca721-abd2-47e5-9a82-af94bd893eec admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:19.712252 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1364/2737] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:19.716802 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:19.727785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7faf31-5e13-4284-a7cb-dc110c4afdba admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:19.732422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:19.733293 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.733585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.733863 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] PATH_INFO: `/v3/projects/60e41f3c3fe94e72ab1cd32ba53eaf57/users/be89b3c0c2344d5397ec7014119bc477/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.749160 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e41f3c3fe94e72ab1cd32ba53eaf57, user_id=be89b3c0c2344d5397ec7014119bc477, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:19.751976 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:19.939123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1374/2738] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:19 2022] PUT /identity/v3/projects/60e41f3c3fe94e72ab1cd32ba53eaf57/users/be89b3c0c2344d5397ec7014119bc477/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:19.949639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a38b-8301-41cb-9d88-a21f3d50b1ba None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:19.949927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a38b-8301-41cb-9d88-a21f3d50b1ba None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:19.950204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a38b-8301-41cb-9d88-a21f3d50b1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:19.978012 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e930a38b-8301-41cb-9d88-a21f3d50b1ba None None] MFA Rules not processed for user `be89b3c0c2344d5397ec7014119bc477`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:19.979273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e930a38b-8301-41cb-9d88-a21f3d50b1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:20.044362 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1365/2739] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:20.055302 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:20.057146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:20.136950 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97db09-1840-4e25-8184-ad1b9c8e244a admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:20.142701 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd1abe-942d-4c6c-9063-13d41045dc67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:20.143375 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd1abe-942d-4c6c-9063-13d41045dc67 service nova] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:20.143654 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd1abe-942d-4c6c-9063-13d41045dc67 service nova] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:20.143925 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd1abe-942d-4c6c-9063-13d41045dc67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:20.152811 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd1abe-942d-4c6c-9063-13d41045dc67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:20.154530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd1abe-942d-4c6c-9063-13d41045dc67 service nova] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:20.164594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1375/2740] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:20.354081 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a38b-8301-41cb-9d88-a21f3d50b1ba None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:20.417013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a38b-8301-41cb-9d88-a21f3d50b1ba None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:20.421788 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:20.422664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:20.422972 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:20.423259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] PATH_INFO: `/v3/users/be89b3c0c2344d5397ec7014119bc477` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:20.424514 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be89b3c0c2344d5397ec7014119bc477)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:20.426579 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:20.752542 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be89b3c0c2344d5397ec7014119bc477'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:20.763388 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be89b3c0c2344d5397ec7014119bc477'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:20.886140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be89b3c0c2344d5397ec7014119bc477'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:20.886791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be89b3c0c2344d5397ec7014119bc477'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:20.899697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be89b3c0c2344d5397ec7014119bc477'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:20.905843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1366/2741] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:20 2022] DELETE /identity/v3/users/be89b3c0c2344d5397ec7014119bc477 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:20.926265 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:20.926772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:20.926947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:20.945743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:20.947012 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:21.007882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1376/2742] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:21.017849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:21.019392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:21.081159 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43c53a-d73c-4e21-983c-88ada306edc7 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:21.085503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a28aa-87d7-4975-b628-71165188567c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:21.086284 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a28aa-87d7-4975-b628-71165188567c service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:21.086654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a28aa-87d7-4975-b628-71165188567c service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:21.086984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a28aa-87d7-4975-b628-71165188567c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:21.096649 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a28aa-87d7-4975-b628-71165188567c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:21.098141 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a28aa-87d7-4975-b628-71165188567c service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:21.108511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1367/2743] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:21.541102 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:21.542503 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:21.560117 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09aa12-532d-4746-97b9-8764ce9a0b96 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:21.566137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:21.569054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:21.569054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:21.569054 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] PATH_INFO: `/v3/projects/60e41f3c3fe94e72ab1cd32ba53eaf57` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:21.570706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e41f3c3fe94e72ab1cd32ba53eaf57)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:21.574511 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:21.722317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e41f3c3fe94e72ab1cd32ba53eaf57', 'request_id': 'req-00e94c8b-ddf4-4ffe-a126-18054f397990'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:21.728006 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e41f3c3fe94e72ab1cd32ba53eaf57', 'request_id': 'req-00e94c8b-ddf4-4ffe-a126-18054f397990'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:21.864752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e41f3c3fe94e72ab1cd32ba53eaf57', 'request_id': 'req-00e94c8b-ddf4-4ffe-a126-18054f397990'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:21.876984 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] The token cache is being invalidate because project 60e41f3c3fe94e72ab1cd32ba53eaf57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:21.877351 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:21.877993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-00e94c8b-ddf4-4ffe-a126-18054f397990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:21.879773 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1377/2744] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:21 2022] DELETE /identity/v3/projects/60e41f3c3fe94e72ab1cd32ba53eaf57 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:21.887259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7fd71-61f2-4612-9e2d-df48181a359f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:21.887837 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7fd71-61f2-4612-9e2d-df48181a359f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:21.888072 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7fd71-61f2-4612-9e2d-df48181a359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:21.907721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-d6e7fd71-61f2-4612-9e2d-df48181a359f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:21.915999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d6e7fd71-61f2-4612-9e2d-df48181a359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:21.974253 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1368/2745] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:21.982943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfebfa5-188b-413f-8f34-b0362b74d37f None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:21.983415 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfebfa5-188b-413f-8f34-b0362b74d37f None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:21.983512 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfebfa5-188b-413f-8f34-b0362b74d37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.004236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dcfebfa5-188b-413f-8f34-b0362b74d37f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:22.006208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dcfebfa5-188b-413f-8f34-b0362b74d37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:22.015182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1378/2746] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:05:22.023694 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7fd71-61f2-4612-9e2d-df48181a359f None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:22.034066 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7fd71-61f2-4612-9e2d-df48181a359f None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:22.039365 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:22.040050 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.040351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.040625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.041459 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:05:22.041798 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:22.043431 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:22.056251 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1369/2747] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 10:05:22.060710 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfebfa5-188b-413f-8f34-b0362b74d37f None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:22.070457 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfebfa5-188b-413f-8f34-b0362b74d37f None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:22.075321 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:22.076042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.076407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.076685 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.077395 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:22.079495 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:22.186103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1379/2748] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:22 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:22.190129 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:22.200503 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e40f-2f3f-43db-af37-4931da319486 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:22.268736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:22.268736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.268736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.268736 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.269121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:22.269121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:22.384261 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1370/2749] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:22 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:22.388869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:22.400004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770f61-84f8-480a-875c-47b9a0718bb5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:22.404845 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:22.411122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.411122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.411122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.411122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:22.411122 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:22.419656 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1380/2750] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:22.423731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:22.433666 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1945-16c3-484d-8ab9-fc9b50f4701f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:22.438425 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5805a2-dfe8-47f0-92e1-d3f52d577483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:22.439111 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5805a2-dfe8-47f0-92e1-d3f52d577483 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.439399 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5805a2-dfe8-47f0-92e1-d3f52d577483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.439677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5805a2-dfe8-47f0-92e1-d3f52d577483 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.440415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5805a2-dfe8-47f0-92e1-d3f52d577483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:22.442014 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5805a2-dfe8-47f0-92e1-d3f52d577483 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:22.453070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1371/2751] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:22.459455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:22.469444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208ad5-380d-4b7c-bb1f-55f1186ab5bc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:22.474181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:22.475643 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.475926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.476763 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] PATH_INFO: `/v3/projects/24077b3a93254c3887e4ef6df3032f75/users/f0aedad1da5d47c9b307c054fab0da1b/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.492099 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=24077b3a93254c3887e4ef6df3032f75, user_id=f0aedad1da5d47c9b307c054fab0da1b, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:22.494809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:22.624813 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1381/2752] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:22 2022] PUT /identity/v3/projects/24077b3a93254c3887e4ef6df3032f75/users/f0aedad1da5d47c9b307c054fab0da1b/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:22.629953 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2da7b-6f87-4891-afe3-63db7f8d9e66 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.630242 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2da7b-6f87-4891-afe3-63db7f8d9e66 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.630518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2da7b-6f87-4891-afe3-63db7f8d9e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.648790 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-3af2da7b-6f87-4891-afe3-63db7f8d9e66 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:22.649987 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3af2da7b-6f87-4891-afe3-63db7f8d9e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:22.707956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1372/2753] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:22.717469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:22.719245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:22.775336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961df298-00be-42d7-9a4a-e0219fb914bf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:22.779028 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:22.779670 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:22.779954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:22.780325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:22.790188 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:22.792615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:22.804520 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1382/2754] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:24.855925 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97e16-bd5f-4414-9800-235add210955 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:24.857538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97e16-bd5f-4414-9800-235add210955 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:24.857538 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97e16-bd5f-4414-9800-235add210955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:24.886299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2ce97e16-bd5f-4414-9800-235add210955 None None] MFA Rules not processed for user `f0aedad1da5d47c9b307c054fab0da1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:24.887548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2ce97e16-bd5f-4414-9800-235add210955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:24.952200 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1373/2755] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:24.967238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:24.967238 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efec50-d586-488f-936d-74092bd0ef73 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:24.971352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:24.972066 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:24.972377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:24.972650 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:24.973372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:24.975897 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:25.134775 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1383/2756] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:24 2022] POST /identity/v3/projects => generated 403 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:25.138880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce97e16-bd5f-4414-9800-235add210955 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:25.150663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce97e16-bd5f-4414-9800-235add210955 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:25.209383 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:25.210048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:25.210332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:25.210597 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:25.211384 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:25.214289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:25.327063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1374/2757] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:25 2022] POST /identity/v3/users => generated 308 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:25.331136 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:25.343860 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875edb-88a7-447d-b9de-9cb060c50073 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:25.348602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:25.349271 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:25.350279 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:25.350426 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:25.351171 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:25.353034 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:25.363884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1384/2758] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:25.368151 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:25.378348 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517fd7e-6dc5-4644-a559-00f9b3edc684 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:25.383583 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:25.388332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:25.388332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:25.388332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] PATH_INFO: `/v3/projects/9f926d4e37384aeca743952458c23c1f/users/169950a3ffe34edfbb4199f22d2e1f7b/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:25.400549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f926d4e37384aeca743952458c23c1f, user_id=169950a3ffe34edfbb4199f22d2e1f7b, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:25.403319 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:25.515919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1375/2759] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:25 2022] PUT /identity/v3/projects/9f926d4e37384aeca743952458c23c1f/users/169950a3ffe34edfbb4199f22d2e1f7b/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:25.520074 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:25.530707 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ce7c-038f-4be9-b2d9-88164a8afa4c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:25.587045 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:25.587714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:25.587997 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:25.588540 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:25.589208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:25.590825 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:25.601115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1385/2760] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:25.605621 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:25.616377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ae432-ae78-4029-812c-20a6fb60cfef admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:25.621162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d172fc-4f6c-4ab6-9dd9-7186532582ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:25.622036 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d172fc-4f6c-4ab6-9dd9-7186532582ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:25.622315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d172fc-4f6c-4ab6-9dd9-7186532582ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:25.622614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d172fc-4f6c-4ab6-9dd9-7186532582ea admin admin] PATH_INFO: `/v3/projects/9f926d4e37384aeca743952458c23c1f/users/169950a3ffe34edfbb4199f22d2e1f7b/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:25.624587 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d172fc-4f6c-4ab6-9dd9-7186532582ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f926d4e37384aeca743952458c23c1f, user_id=169950a3ffe34edfbb4199f22d2e1f7b, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:25.627272 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d172fc-4f6c-4ab6-9dd9-7186532582ea admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:25.637484 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1376/2761] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:25 2022] PUT /identity/v3/projects/9f926d4e37384aeca743952458c23c1f/users/169950a3ffe34edfbb4199f22d2e1f7b/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:26.352010 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:26.353967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:26.366923 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69c166-13c1-4d0d-91cc-0a8d5bd87d88 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:26.425249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:26.426114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:26.426394 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:26.426664 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] PATH_INFO: `/v3/users/8d2e2ed7bd094e33ad8bbb43674a4fd9` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:26.428496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2e2ed7bd094e33ad8bbb43674a4fd9)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:26.430467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:26.768499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2e2ed7bd094e33ad8bbb43674a4fd9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:26.775666 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2e2ed7bd094e33ad8bbb43674a4fd9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:26.776324 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2e2ed7bd094e33ad8bbb43674a4fd9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:26.909772 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2e2ed7bd094e33ad8bbb43674a4fd9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:26.923743 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2e2ed7bd094e33ad8bbb43674a4fd9'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:26.930587 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1386/2762] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:26 2022] DELETE /identity/v3/users/8d2e2ed7bd094e33ad8bbb43674a4fd9 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:26.935274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075befa9-15de-4768-a311-afec5307920f None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:26.935788 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075befa9-15de-4768-a311-afec5307920f None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:26.935901 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075befa9-15de-4768-a311-afec5307920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:26.953825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-075befa9-15de-4768-a311-afec5307920f None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:26.957296 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-075befa9-15de-4768-a311-afec5307920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:27.012620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1377/2763] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:27.023158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:27.025256 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:27.083679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6ce4-212f-4dc0-b254-8ff33fbecfa7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:27.088050 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:27.088697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:27.088987 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:27.089425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:27.098784 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:27.100216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:27.111208 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1387/2764] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:27.281194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6343-ff88-4dd4-a09f-35fe1f58d381 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:27.281494 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6343-ff88-4dd4-a09f-35fe1f58d381 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:27.281754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6343-ff88-4dd4-a09f-35fe1f58d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:27.313684 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-037f6343-ff88-4dd4-a09f-35fe1f58d381 None None] MFA Rules not processed for user `169950a3ffe34edfbb4199f22d2e1f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:27.314952 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-037f6343-ff88-4dd4-a09f-35fe1f58d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:27.394747 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1378/2765] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:27.746530 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:27.748221 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:27.762124 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04328ffc-e169-4620-9434-8b605e14bcbd service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:27.767101 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:27.768005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:27.768288 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:27.768566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] PATH_INFO: `/v3/projects/01bca34fffd14373b152bce1b4c5633f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:27.769797 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bca34fffd14373b152bce1b4c5633f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:27.771842 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:27.954425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bca34fffd14373b152bce1b4c5633f', 'request_id': 'req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:27.960667 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bca34fffd14373b152bce1b4c5633f', 'request_id': 'req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:28.040927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bca34fffd14373b152bce1b4c5633f', 'request_id': 'req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:28.054385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] The token cache is being invalidate because project 01bca34fffd14373b152bce1b4c5633f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:28.054874 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:28.055564 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-38ab14e3-d96e-4f55-9f4e-0009fe3db9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:28.057244 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1388/2766] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:27 2022] DELETE /identity/v3/projects/01bca34fffd14373b152bce1b4c5633f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:28.063274 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fdb4-bc9e-42bc-a424-0b5e753061e6 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.063784 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fdb4-bc9e-42bc-a424-0b5e753061e6 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.063886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fdb4-bc9e-42bc-a424-0b5e753061e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.083450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-2693fdb4-bc9e-42bc-a424-0b5e753061e6 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:28.085241 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2693fdb4-bc9e-42bc-a424-0b5e753061e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:28.145015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1379/2767] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:28.161317 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5647c-ca31-4c40-aabc-cd807de7af80 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.161597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5647c-ca31-4c40-aabc-cd807de7af80 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.162423 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5647c-ca31-4c40-aabc-cd807de7af80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.180575 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c9f5647c-ca31-4c40-aabc-cd807de7af80 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:28.181760 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c9f5647c-ca31-4c40-aabc-cd807de7af80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:28.190556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1389/2768] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:28.198128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693fdb4-bc9e-42bc-a424-0b5e753061e6 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.208250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693fdb4-bc9e-42bc-a424-0b5e753061e6 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.213856 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.214488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.214775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.215052 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.215783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:05:28.216083 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.217847 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:28.231373 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1380/2769] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:05:28.238275 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5647c-ca31-4c40-aabc-cd807de7af80 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.248962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5647c-ca31-4c40-aabc-cd807de7af80 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.254109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.254898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.255184 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.255487 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.256786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.258693 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:28.362065 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1390/2770] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:28 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:28.367150 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.378420 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f632a3-c241-45fd-bd7f-e02111da6dc8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.439356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.440021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.440299 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.440601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.441315 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.443469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:28.550096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1381/2771] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:28 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:28.551427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.562758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a07fa4-19fc-457c-ab4a-d3ba0ea430ee admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.567583 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.568869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.569251 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.569546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.570270 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.571893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:28.582758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1391/2772] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:28.587421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.597467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a536a0-0c88-4592-8bab-2216fae6f1da admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.603026 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c00a5-4531-476b-aa3c-7ba66486960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.603688 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c00a5-4531-476b-aa3c-7ba66486960e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.603971 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c00a5-4531-476b-aa3c-7ba66486960e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.604260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c00a5-4531-476b-aa3c-7ba66486960e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.605001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c00a5-4531-476b-aa3c-7ba66486960e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.606603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c00a5-4531-476b-aa3c-7ba66486960e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:28.616561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1382/2773] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:28.620746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.631313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1ff8-55d6-4aeb-af72-130847b5b15b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.636944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.637877 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.638156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.638427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] PATH_INFO: `/v3/projects/abba12a7c8bf4381b4ca8742e8354cc7/users/14db3e2d0d2c43e883e64287c9daf15c/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.663901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abba12a7c8bf4381b4ca8742e8354cc7, user_id=14db3e2d0d2c43e883e64287c9daf15c, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.666582 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:28.744953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1392/2774] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:28 2022] PUT /identity/v3/projects/abba12a7c8bf4381b4ca8742e8354cc7/users/14db3e2d0d2c43e883e64287c9daf15c/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:28.750060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.750286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.750563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.770146 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:28.771999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:28.834548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1383/2775] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:28.844230 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.846182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:28.905484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da826c2-05da-42b1-b4a3-5c5a2e2a8813 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.909359 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.910000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.910350 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.910660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.921147 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.922628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:28.926693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:28.928185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:28.936113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1393/2776] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:28.943776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0d7c-9c4a-4eb0-b027-8daf1dccd102 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:28.946599 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:28.947567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:28.947851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:28.948122 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] PATH_INFO: `/v3/users/f0aedad1da5d47c9b307c054fab0da1b` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:28.949387 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0aedad1da5d47c9b307c054fab0da1b)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:28.951370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:29.203054 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0aedad1da5d47c9b307c054fab0da1b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:29.209518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0aedad1da5d47c9b307c054fab0da1b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:29.344091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0aedad1da5d47c9b307c054fab0da1b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:29.344782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0aedad1da5d47c9b307c054fab0da1b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:29.358838 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0aedad1da5d47c9b307c054fab0da1b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:29.364885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1384/2777] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:28 2022] DELETE /identity/v3/users/f0aedad1da5d47c9b307c054fab0da1b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:29.729591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:29.742444 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604aa7-7703-4c11-8408-f90e6fd77154 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:29.801596 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:29.803069 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:29.803355 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:29.803647 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] PATH_INFO: `/v3/projects/24077b3a93254c3887e4ef6df3032f75` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:29.804927 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=24077b3a93254c3887e4ef6df3032f75)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:29.807044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:29.945309 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24077b3a93254c3887e4ef6df3032f75', 'request_id': 'req-210632fb-aa0a-41ed-a38d-b286c16c64bf'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:29.950880 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24077b3a93254c3887e4ef6df3032f75', 'request_id': 'req-210632fb-aa0a-41ed-a38d-b286c16c64bf'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.121005 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24077b3a93254c3887e4ef6df3032f75', 'request_id': 'req-210632fb-aa0a-41ed-a38d-b286c16c64bf'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.132731 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] The token cache is being invalidate because project 24077b3a93254c3887e4ef6df3032f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:30.134639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.134639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.135313 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1394/2778] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:29 2022] DELETE /identity/v3/projects/24077b3a93254c3887e4ef6df3032f75 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:30.139189 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:30.140582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:30.154139 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f652a1-bf8b-46f4-a1ee-58da49aa039b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:30.207426 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:30.208208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:30.208509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:30.208776 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] PATH_INFO: `/v3/users/169950a3ffe34edfbb4199f22d2e1f7b` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:30.209950 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=169950a3ffe34edfbb4199f22d2e1f7b)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:30.211884 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:30.484140 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169950a3ffe34edfbb4199f22d2e1f7b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.491585 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169950a3ffe34edfbb4199f22d2e1f7b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.648341 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169950a3ffe34edfbb4199f22d2e1f7b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.649147 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169950a3ffe34edfbb4199f22d2e1f7b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.665003 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-caf94113-2b79-4341-8c9f-6744bdacd47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169950a3ffe34edfbb4199f22d2e1f7b'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:30.671543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1385/2779] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:05:30 2022] DELETE /identity/v3/users/169950a3ffe34edfbb4199f22d2e1f7b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:31.009649 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:31.011617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:31.036757 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210632fb-aa0a-41ed-a38d-b286c16c64bf admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:31.112450 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:31.113615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:31.113967 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:31.114315 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] PATH_INFO: `/v3/projects/9f926d4e37384aeca743952458c23c1f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:31.115745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f926d4e37384aeca743952458c23c1f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:31.117744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:31.288430 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f926d4e37384aeca743952458c23c1f', 'request_id': 'req-31213725-0c2e-4a0d-85db-0924a1786325'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:31.293755 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f926d4e37384aeca743952458c23c1f', 'request_id': 'req-31213725-0c2e-4a0d-85db-0924a1786325'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:31.370945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f926d4e37384aeca743952458c23c1f', 'request_id': 'req-31213725-0c2e-4a0d-85db-0924a1786325'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:31.385185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] The token cache is being invalidate because project 9f926d4e37384aeca743952458c23c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:05:31.385485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:31.386331 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-31213725-0c2e-4a0d-85db-0924a1786325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:05:31.388402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1395/2780] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:05:31 2022] DELETE /identity/v3/projects/9f926d4e37384aeca743952458c23c1f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:31.394064 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c735a9-b73f-4ec6-83f2-b950a1dd0c98 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:31.394547 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c735a9-b73f-4ec6-83f2-b950a1dd0c98 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:31.394663 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c735a9-b73f-4ec6-83f2-b950a1dd0c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:31.417780 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-e0c735a9-b73f-4ec6-83f2-b950a1dd0c98 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:31.420451 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-e0c735a9-b73f-4ec6-83f2-b950a1dd0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:31.500530 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1386/2781] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:31.513903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725aaa6-7b93-430a-9b57-1f283d102e31 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:31.513903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725aaa6-7b93-430a-9b57-1f283d102e31 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:31.513903 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725aaa6-7b93-430a-9b57-1f283d102e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:31.548627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-6725aaa6-7b93-430a-9b57-1f283d102e31 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:31.549849 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-6725aaa6-7b93-430a-9b57-1f283d102e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:31.558962 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1396/2782] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:31.563217 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c735a9-b73f-4ec6-83f2-b950a1dd0c98 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:31.582703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c735a9-b73f-4ec6-83f2-b950a1dd0c98 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:31.588935 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:31.589959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:31.590405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:31.590678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:31.591493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:05:31.592636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:31.594268 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:31.609898 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1387/2783] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:05:31.614573 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725aaa6-7b93-430a-9b57-1f283d102e31 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:31.625044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725aaa6-7b93-430a-9b57-1f283d102e31 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:31.630929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:31.631640 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:31.639247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:31.639247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:31.639247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:31.639247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:31.777193 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1397/2784] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:31 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:31.778332 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:31.789283 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade569-745b-43ff-b286-bce9ace0d523 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:31.845205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:31.845879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:31.846161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:31.846438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:31.847206 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:31.849716 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:31.955958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1388/2785] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:31 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:31.960796 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:31.971630 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1227284-9e40-48be-b634-145e1e18bdd3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:31.976870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:31.977782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:31.978070 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:31.978342 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:31.979113 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:31.980715 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:31.992016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1398/2786] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:31.996249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:32.006890 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838cb6e-7ba5-4bd4-acc7-e0ef30488c32 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:32.011965 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49e17-ae25-4680-9978-8321afcb6e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:32.012652 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49e17-ae25-4680-9978-8321afcb6e6e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:32.013292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49e17-ae25-4680-9978-8321afcb6e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:32.013292 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49e17-ae25-4680-9978-8321afcb6e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:32.013947 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49e17-ae25-4680-9978-8321afcb6e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:32.015962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49e17-ae25-4680-9978-8321afcb6e6e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:32.029313 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1389/2787] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:32.033589 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:32.044390 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404985c-8523-4de4-8f18-a87b2b6132dc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:32.049181 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:32.050068 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:32.050347 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:32.050619 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] PATH_INFO: `/v3/projects/c8a030163a0e40b4ae2525d0df70693a/users/e1ea16f28d2948b7be56b1c1636398d7/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:32.066959 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a030163a0e40b4ae2525d0df70693a, user_id=e1ea16f28d2948b7be56b1c1636398d7, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:32.069696 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:32.202460 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1399/2788] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:32 2022] PUT /identity/v3/projects/c8a030163a0e40b4ae2525d0df70693a/users/e1ea16f28d2948b7be56b1c1636398d7/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:32.214527 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb56c93-2494-4e59-b10e-132cd649a526 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:32.214865 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb56c93-2494-4e59-b10e-132cd649a526 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:32.215132 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb56c93-2494-4e59-b10e-132cd649a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:32.245385 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-0eb56c93-2494-4e59-b10e-132cd649a526 None None] MFA Rules not processed for user `e1ea16f28d2948b7be56b1c1636398d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:32.246638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0eb56c93-2494-4e59-b10e-132cd649a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:32.327205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1390/2789] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:32.331607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:32.414042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed39bad-9f13-40ac-933e-5cc094af42fe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:32.419801 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:32.420472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:32.420750 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:32.421021 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:32.421761 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:32.423712 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:32.561742 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1400/2790] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:32 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:32.565849 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb56c93-2494-4e59-b10e-132cd649a526 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:32.591912 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb56c93-2494-4e59-b10e-132cd649a526 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:32.682824 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:32.683482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:32.683765 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:32.684033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:32.684825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:32.690059 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:32.892595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1391/2791] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:32 2022] POST /identity/v3/users => generated 295 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:05:32.896749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:32.908286 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4d15-34c0-48e4-a6cf-3c1af4fbb299 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:32.913648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:32.914303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:32.914588 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:32.914975 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:32.915751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:32.917501 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:32.928579 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1401/2792] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:32.932718 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:32.943194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de812ea-6db4-4192-a0b4-2ed7c171bf8f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:32.947476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:32.976692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:32.976692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:32.976692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] PATH_INFO: `/v3/projects/90830cb8ea0149b2800141e33cc8fbfb/users/5ea8a843ddf04b7d9a3eb0e590c30e6e/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:32.976692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90830cb8ea0149b2800141e33cc8fbfb, user_id=5ea8a843ddf04b7d9a3eb0e590c30e6e, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:32.976692 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:33.264062 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1392/2793] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:32 2022] PUT /identity/v3/projects/90830cb8ea0149b2800141e33cc8fbfb/users/5ea8a843ddf04b7d9a3eb0e590c30e6e/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:33.268273 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:33.279943 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ccc10-dc4d-4c0a-b030-59a7ed5bf4d3 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:33.344370 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3495faa-691a-459d-ac88-ab3b5f4cd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:33.346027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495faa-691a-459d-ac88-ab3b5f4cd2af admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:33.346027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495faa-691a-459d-ac88-ab3b5f4cd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:33.346027 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495faa-691a-459d-ac88-ab3b5f4cd2af admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:33.346408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3495faa-691a-459d-ac88-ab3b5f4cd2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:33.348434 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3495faa-691a-459d-ac88-ab3b5f4cd2af admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:33.363893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1402/2794] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:33.370167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:33.383130 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514c1a-599f-4a5d-ac29-f0c33a5faed6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:33.388001 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:33.389015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:33.389352 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:33.389711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] PATH_INFO: `/v3/projects/90830cb8ea0149b2800141e33cc8fbfb/users/5ea8a843ddf04b7d9a3eb0e590c30e6e/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:33.392145 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90830cb8ea0149b2800141e33cc8fbfb, user_id=5ea8a843ddf04b7d9a3eb0e590c30e6e, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:33.395091 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:33.419337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1393/2795] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:33 2022] PUT /identity/v3/projects/90830cb8ea0149b2800141e33cc8fbfb/users/5ea8a843ddf04b7d9a3eb0e590c30e6e/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:33.421599 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6463-9c2c-4704-bffd-5d9f9b25fdf1 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:33.421929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6463-9c2c-4704-bffd-5d9f9b25fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:33.422366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6463-9c2c-4704-bffd-5d9f9b25fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:33.454615 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-cc6f6463-9c2c-4704-bffd-5d9f9b25fdf1 None None] MFA Rules not processed for user `5ea8a843ddf04b7d9a3eb0e590c30e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:33.456048 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-cc6f6463-9c2c-4704-bffd-5d9f9b25fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:33.541425 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1403/2796] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:33.551415 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:33.553843 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:33.627121 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d780850-f5af-4855-b7e3-14cabd4e6bf6 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:33.632022 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:33.633205 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:33.633474 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:33.633867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:33.712423 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:33.714112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:33.730407 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1394/2797] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:35.460379 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499932-7d07-42bf-8ab0-c183a995832d None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:35.460905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499932-7d07-42bf-8ab0-c183a995832d None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:35.460991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499932-7d07-42bf-8ab0-c183a995832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:35.504185 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-12499932-7d07-42bf-8ab0-c183a995832d None None] MFA Rules not processed for user `14db3e2d0d2c43e883e64287c9daf15c`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:35.505893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-12499932-7d07-42bf-8ab0-c183a995832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:35.577982 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1404/2798] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:35.582637 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:35.584185 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:35.657497 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbb2ae-6bea-4940-9207-8f16b0dea1c2 service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:35.662335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:35.663021 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:35.663302 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:35.663571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:35.664269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:35.666209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:35.831672 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1395/2799] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:05:35 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:35.837740 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12499932-7d07-42bf-8ab0-c183a995832d None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:35.859816 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12499932-7d07-42bf-8ab0-c183a995832d None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:35.931351 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:35.932556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:35.933041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:35.933554 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:35.935033 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:35.937645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:36.111737 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1405/2800] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:05:35 2022] POST /identity/v3/users => generated 292 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:05:36.116643 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:36.127591 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620029d-fcf6-4025-99fc-2073ab00c9c9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:36.133586 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:36.134269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:36.134697 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:36.134914 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:36.136148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:36.137480 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:36.148825 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1396/2801] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:36.153152 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:36.163657 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8bb8-1f9a-46c3-bea5-008e09edbe1e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:36.168491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:36.169369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:36.169660 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:36.169935 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] PATH_INFO: `/v3/projects/2db1264c7b224369bc8d357621c6c3e5/users/7324f0ad5f3843579a481169ae37170f/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:36.187343 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db1264c7b224369bc8d357621c6c3e5, user_id=7324f0ad5f3843579a481169ae37170f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:36.204455 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:36.362422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1406/2802] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:36 2022] PUT /identity/v3/projects/2db1264c7b224369bc8d357621c6c3e5/users/7324f0ad5f3843579a481169ae37170f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:05:36.370828 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:36.389854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0d674-e9b9-4737-9bfa-15228b3e10cb admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:36.452353 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:36.453197 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:36.453488 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:36.453774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:36.454518 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:36.456493 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:36.469549 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1397/2803] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:05:36.473632 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:36.484628 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c88f28-8443-4036-a047-b4e0cfb4d5fc admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:36.490549 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67596b91-1dff-48c2-9f20-247093ee7915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:36.491634 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596b91-1dff-48c2-9f20-247093ee7915 admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:36.491991 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596b91-1dff-48c2-9f20-247093ee7915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:36.492335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596b91-1dff-48c2-9f20-247093ee7915 admin admin] PATH_INFO: `/v3/projects/2db1264c7b224369bc8d357621c6c3e5/users/7324f0ad5f3843579a481169ae37170f/roles/c81c29874f234512920b18621694f614` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:36.494470 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67596b91-1dff-48c2-9f20-247093ee7915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db1264c7b224369bc8d357621c6c3e5, user_id=7324f0ad5f3843579a481169ae37170f, role_id=c81c29874f234512920b18621694f614)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:36.497247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67596b91-1dff-48c2-9f20-247093ee7915 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:36.509910 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1407/2804] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:05:36 2022] PUT /identity/v3/projects/2db1264c7b224369bc8d357621c6c3e5/users/7324f0ad5f3843579a481169ae37170f/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:05:43.075931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:43.075931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:43.135737 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f7859-a6f0-4562-be89-29dcbe9034c1 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:43.189294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:43.189957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:43.190249 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:43.190520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:43.257731 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:43.259598 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:43.271390 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1398/2805] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:43.975708 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519a0c-46fe-43d0-9907-0c310981e202 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:43.976360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519a0c-46fe-43d0-9907-0c310981e202 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:43.976360 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519a0c-46fe-43d0-9907-0c310981e202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:44.008699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c6519a0c-46fe-43d0-9907-0c310981e202 None None] MFA Rules not processed for user `7324f0ad5f3843579a481169ae37170f`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:44.010040 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c6519a0c-46fe-43d0-9907-0c310981e202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:44.085931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1408/2806] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:05:44.098090 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:05:44.102995 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:44.179234 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff964d-517b-4d27-8469-260e3b140efd service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:05:44.184789 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:05:44.185435 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:44.185714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:44.185991 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:44.242434 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:05:44.244148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:05:44.253819 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1399/2807] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:05:47.801182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:05:47.801182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:05:47.801182 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:05:47.816655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] MFA Rules not processed for user `14db3e2d0d2c43e883e64287c9daf15c`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:05:47.818838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:05:47.825900 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1409/2808] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:21.349024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:21.463714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f59f-a298-4269-938d-f88b8816c6c9 service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:21.468421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:21.469280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:21.469561 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:21.469835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] PATH_INFO: `/v3/users/e1ea16f28d2948b7be56b1c1636398d7` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:21.471212 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ea16f28d2948b7be56b1c1636398d7)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:21.473350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:21.764847 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:21.771052 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:21.814331 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ea16f28d2948b7be56b1c1636398d7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:21.821560 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ea16f28d2948b7be56b1c1636398d7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:21.881096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b9269-bab2-4be0-87c4-35a712eb0439 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:21.884915 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9215c-41b1-4062-8120-6a418564f1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:21.891290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9215c-41b1-4062-8120-6a418564f1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:21.891290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9215c-41b1-4062-8120-6a418564f1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:21.891290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9215c-41b1-4062-8120-6a418564f1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:21.891290 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b9e9215c-41b1-4062-8120-6a418564f1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:21.898568 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9215c-41b1-4062-8120-6a418564f1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:21.900071 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9215c-41b1-4062-8120-6a418564f1d6 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:21.908146 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1410/2809] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 10:06:21.924975 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ea16f28d2948b7be56b1c1636398d7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:21.926247 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ea16f28d2948b7be56b1c1636398d7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:21.940729 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ea16f28d2948b7be56b1c1636398d7'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:21.947512 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1400/2810] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:06:21 2022] DELETE /identity/v3/users/e1ea16f28d2948b7be56b1c1636398d7 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:21.952433 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:21.952725 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:21.953192 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:21.994493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:21.995782 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:22.058709 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1411/2811] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:22.073680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:22.075157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:22.138654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076011-139d-4a96-8287-18d84244042b admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:22.142477 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:22.143157 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:22.143438 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:22.143713 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:22.153719 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:22.155219 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:22.166142 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1401/2812] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:06:22.602195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:22.604276 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:22.618490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9edb-e91f-4887-aa93-c9064326dd4e None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:22.623597 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:22.624561 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:22.624843 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:22.625222 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] PATH_INFO: `/v3/projects/c8a030163a0e40b4ae2525d0df70693a` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:22.626374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a030163a0e40b4ae2525d0df70693a)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:22.629340 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:22.806788 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a030163a0e40b4ae2525d0df70693a', 'request_id': 'req-7791b5a5-731a-43c5-8408-9b362727f28c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:22.812206 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a030163a0e40b4ae2525d0df70693a', 'request_id': 'req-7791b5a5-731a-43c5-8408-9b362727f28c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:22.890626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a030163a0e40b4ae2525d0df70693a', 'request_id': 'req-7791b5a5-731a-43c5-8408-9b362727f28c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:22.909803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] The token cache is being invalidate because project c8a030163a0e40b4ae2525d0df70693a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:06:22.909803 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:22.911051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:22.913499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1412/2813] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:06:22 2022] DELETE /identity/v3/projects/c8a030163a0e40b4ae2525d0df70693a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:22.917758 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:22.928567 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9320-a5c4-4b14-bcf5-c8118966826f service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:22.983711 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:22.984491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:22.984772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:22.985049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] PATH_INFO: `/v3/users/5ea8a843ddf04b7d9a3eb0e590c30e6e` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:22.986243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea8a843ddf04b7d9a3eb0e590c30e6e)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:22.988707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:23.207181 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea8a843ddf04b7d9a3eb0e590c30e6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:23.214102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea8a843ddf04b7d9a3eb0e590c30e6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:23.353604 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea8a843ddf04b7d9a3eb0e590c30e6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:23.354250 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea8a843ddf04b7d9a3eb0e590c30e6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:23.367710 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-cf570de6-11f1-4b46-bba3-fac0acdeb391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea8a843ddf04b7d9a3eb0e590c30e6e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:23.373725 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1402/2814] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:06:22 2022] DELETE /identity/v3/users/5ea8a843ddf04b7d9a3eb0e590c30e6e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:23.852983 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:23.857233 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:23.870086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791b5a5-731a-43c5-8408-9b362727f28c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:23.929698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:23.930556 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:23.930878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:23.931201 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] PATH_INFO: `/v3/projects/90830cb8ea0149b2800141e33cc8fbfb` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:23.932386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90830cb8ea0149b2800141e33cc8fbfb)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:23.934278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:24.107669 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90830cb8ea0149b2800141e33cc8fbfb', 'request_id': 'req-fb3b457a-0da9-4f1c-a891-d16bcc53455a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:24.113237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90830cb8ea0149b2800141e33cc8fbfb', 'request_id': 'req-fb3b457a-0da9-4f1c-a891-d16bcc53455a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:24.193826 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90830cb8ea0149b2800141e33cc8fbfb', 'request_id': 'req-fb3b457a-0da9-4f1c-a891-d16bcc53455a'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:24.205929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] The token cache is being invalidate because project 90830cb8ea0149b2800141e33cc8fbfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:06:24.206216 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:24.207441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-fb3b457a-0da9-4f1c-a891-d16bcc53455a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:24.209056 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1413/2815] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:06:23 2022] DELETE /identity/v3/projects/90830cb8ea0149b2800141e33cc8fbfb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:24.214756 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a23a7-0538-49f9-82ed-333e5ecd2490 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.222791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a23a7-0538-49f9-82ed-333e5ecd2490 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.222791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a23a7-0538-49f9-82ed-333e5ecd2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.252416 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-f50a23a7-0538-49f9-82ed-333e5ecd2490 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:24.254370 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f50a23a7-0538-49f9-82ed-333e5ecd2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:24.319096 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1403/2816] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:24.328042 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3753583-5c83-4dbf-956c-bb32b0d1a848 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.328334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3753583-5c83-4dbf-956c-bb32b0d1a848 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.328617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3753583-5c83-4dbf-956c-bb32b0d1a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.347514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b3753583-5c83-4dbf-956c-bb32b0d1a848 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:24.348661 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b3753583-5c83-4dbf-956c-bb32b0d1a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:24.357496 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1414/2817] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:24.361814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a23a7-0538-49f9-82ed-333e5ecd2490 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:24.373027 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a23a7-0538-49f9-82ed-333e5ecd2490 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:24.377958 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:24.379204 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.379482 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.379754 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] PATH_INFO: `/v3/domains` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.380521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:06:24.380854 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:24.382457 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:24.394896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1404/2818] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:06:24.399094 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3753583-5c83-4dbf-956c-bb32b0d1a848 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:24.408092 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3753583-5c83-4dbf-956c-bb32b0d1a848 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:24.413544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:24.414214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.414490 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.414821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.415544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:24.417437 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:24.655367 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1415/2819] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:06:24 2022] POST /identity/v3/projects => generated 379 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:06:24.657024 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:24.667398 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baa325-f4c3-4c95-a75a-c62f51059108 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:24.723973 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:24.724636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.732166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.732166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.732166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:24.732166 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:24.840019 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1405/2820] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:06:24 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:06:24.844436 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:24.857130 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12595c79-d09b-4160-b451-a8ba40a6411f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:24.861980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:24.862758 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.863645 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.863844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.864584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:24.866163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:24.877335 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1416/2821] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:06:24.901948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:24.913891 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98048a37-3907-43a2-b184-6cf799d1e028 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:24.918867 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b342a17-52f8-40cc-a098-c7fca4d68a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:24.919568 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342a17-52f8-40cc-a098-c7fca4d68a9e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.919846 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342a17-52f8-40cc-a098-c7fca4d68a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.920137 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342a17-52f8-40cc-a098-c7fca4d68a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.920857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b342a17-52f8-40cc-a098-c7fca4d68a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:24.922453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b342a17-52f8-40cc-a098-c7fca4d68a9e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:24.938967 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1406/2822] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:06:24.941954 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:24.952422 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b07c7e-370b-4687-89be-546241bbe3fe admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:24.957260 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:24.958134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:24.958417 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:24.958692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] PATH_INFO: `/v3/projects/8db6a2e8d49344ef9f34c68964970cc8/users/19e06f1517dd4e4bb594990554e25319/roles/195819215583470b80fa053d7de42a6c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:24.973526 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db6a2e8d49344ef9f34c68964970cc8, user_id=19e06f1517dd4e4bb594990554e25319, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:24.976459 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:25.056648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1417/2823] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:06:24 2022] PUT /identity/v3/projects/8db6a2e8d49344ef9f34c68964970cc8/users/19e06f1517dd4e4bb594990554e25319/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:25.067176 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633a9b-1444-4039-bfab-8b48612b62b2 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:25.067468 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633a9b-1444-4039-bfab-8b48612b62b2 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:25.067774 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633a9b-1444-4039-bfab-8b48612b62b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:25.097733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-49633a9b-1444-4039-bfab-8b48612b62b2 None None] MFA Rules not processed for user `19e06f1517dd4e4bb594990554e25319`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:25.097733 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-49633a9b-1444-4039-bfab-8b48612b62b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:25.162349 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1407/2824] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:25.167060 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:25.229681 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d80a4f-f298-4d8a-a3d3-0995629f5d2e admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:25.234403 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:25.235085 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:25.235366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:25.235639 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:25.236374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:25.238854 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:25.335507 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1418/2825] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:06:25 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:06:25.336659 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633a9b-1444-4039-bfab-8b48612b62b2 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:25.348086 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633a9b-1444-4039-bfab-8b48612b62b2 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:25.424421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:25.425768 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:25.426063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:25.426337 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] PATH_INFO: `/v3/users` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:25.427098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:25.429005 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:25.603346 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1408/2826] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:06:25 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:06:25.607219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:25.624535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c318f-03a0-4596-bb4d-362d970d6e3b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:25.624535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:25.624535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:25.624535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:25.625207 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:25.625406 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:25.626952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:25.641267 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1419/2827] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:06:25.642703 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:25.652817 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258544-8503-43f0-b539-081e86ecab80 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:25.657829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:25.658752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:25.659203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:25.660262 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] PATH_INFO: `/v3/projects/5aa494a0325140e799a9137d2be22177/users/6cd831c064bc4aa2953e21a691d19291/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:25.676956 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa494a0325140e799a9137d2be22177, user_id=6cd831c064bc4aa2953e21a691d19291, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:25.679937 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:25.925908 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1409/2828] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:06:25 2022] PUT /identity/v3/projects/5aa494a0325140e799a9137d2be22177/users/6cd831c064bc4aa2953e21a691d19291/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:25.929961 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:25.939945 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fd05-2c30-4473-bce0-e6ce9ea516a7 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:25.999940 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c0b69-4432-4b9c-8d44-834e26448cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:26.000885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0b69-4432-4b9c-8d44-834e26448cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:26.001241 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0b69-4432-4b9c-8d44-834e26448cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:26.001624 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c0b69-4432-4b9c-8d44-834e26448cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:26.002767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c0b69-4432-4b9c-8d44-834e26448cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:26.005004 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c0b69-4432-4b9c-8d44-834e26448cc1 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:26.019420 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1420/2829] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:06:26.020892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:26.032071 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498aa4c-0a36-42dd-86c0-2f97ee11fb2f admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:26.040720 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:26.041224 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:26.041509 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:26.041775 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] PATH_INFO: `/v3/projects/5aa494a0325140e799a9137d2be22177/users/6cd831c064bc4aa2953e21a691d19291/roles/c81c29874f234512920b18621694f614` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:26.044500 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa494a0325140e799a9137d2be22177, user_id=6cd831c064bc4aa2953e21a691d19291, role_id=c81c29874f234512920b18621694f614)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:26.047276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:26.058748 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1410/2830] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:06:26 2022] PUT /identity/v3/projects/5aa494a0325140e799a9137d2be22177/users/6cd831c064bc4aa2953e21a691d19291/roles/c81c29874f234512920b18621694f614 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:06:26.070553 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce045-c08f-47cc-883a-de649d699f33 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:26.070948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce045-c08f-47cc-883a-de649d699f33 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:26.071236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ce045-c08f-47cc-883a-de649d699f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:26.106766 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-d95ce045-c08f-47cc-883a-de649d699f33 None None] MFA Rules not processed for user `6cd831c064bc4aa2953e21a691d19291`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:26.108055 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-d95ce045-c08f-47cc-883a-de649d699f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:26.174211 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1421/2831] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:26.184783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:26.186580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:26.249297 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d785-efd0-4779-97fe-b362a94dac1c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:26.253013 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de59cf-51b6-4bb5-886c-e953b60f4348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:26.253800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de59cf-51b6-4bb5-886c-e953b60f4348 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:26.254055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de59cf-51b6-4bb5-886c-e953b60f4348 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:26.254328 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de59cf-51b6-4bb5-886c-e953b60f4348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:26.270192 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de59cf-51b6-4bb5-886c-e953b60f4348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:26.271681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de59cf-51b6-4bb5-886c-e953b60f4348 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:26.283689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1411/2832] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:06:26.928594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ce045-c08f-47cc-883a-de649d699f33 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:26.996886 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ce045-c08f-47cc-883a-de649d699f33 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:27.001706 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:27.002593 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:27.002906 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:27.003219 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] PATH_INFO: `/v3/users/19e06f1517dd4e4bb594990554e25319` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:27.004467 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e06f1517dd4e4bb594990554e25319)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:27.006408 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:27.278119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e06f1517dd4e4bb594990554e25319'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:27.287157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e06f1517dd4e4bb594990554e25319'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:27.288257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e06f1517dd4e4bb594990554e25319'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:27.353893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e06f1517dd4e4bb594990554e25319'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:27.368382 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e06f1517dd4e4bb594990554e25319'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:27.375514 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1422/2833] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:06:26 2022] DELETE /identity/v3/users/19e06f1517dd4e4bb594990554e25319 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:27.380945 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:27.381402 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:27.381880 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:27.401650 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:27.402907 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:27.467714 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1412/2834] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:27.478047 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:27.479560 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:27.538829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bdc2f-c09c-479d-980b-f518cd2c080b admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:27.542606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:27.543356 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:27.543690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:27.543969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:27.558000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:27.564132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:27.578263 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1423/2835] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:06:28.135446 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:28.136879 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:28.149114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748618c8-77b5-44d0-9392-56a5ff07d0ae None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:28.153676 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:28.154523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:28.154827 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:28.155108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] PATH_INFO: `/v3/projects/8db6a2e8d49344ef9f34c68964970cc8` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:28.156290 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db6a2e8d49344ef9f34c68964970cc8)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:28.158172 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:28.336526 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db6a2e8d49344ef9f34c68964970cc8', 'request_id': 'req-d247f064-8d93-4e52-8895-4dd1e803adc0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.340421 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db6a2e8d49344ef9f34c68964970cc8', 'request_id': 'req-d247f064-8d93-4e52-8895-4dd1e803adc0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.416215 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db6a2e8d49344ef9f34c68964970cc8', 'request_id': 'req-d247f064-8d93-4e52-8895-4dd1e803adc0'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.428393 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] The token cache is being invalidate because project 8db6a2e8d49344ef9f34c68964970cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:06:28.428707 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.429334 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.430892 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1413/2836] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:06:28 2022] DELETE /identity/v3/projects/8db6a2e8d49344ef9f34c68964970cc8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:06:28.435179 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:28.445287 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f20254-aa51-4509-8bea-5d0cf4b1d4b3 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:28.500566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:28.501441 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:28.501730 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:28.502000 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] PATH_INFO: `/v3/users/6cd831c064bc4aa2953e21a691d19291` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:28.503835 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd831c064bc4aa2953e21a691d19291)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:28.505808 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:28.743402 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd831c064bc4aa2953e21a691d19291'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.750385 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd831c064bc4aa2953e21a691d19291'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.751109 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd831c064bc4aa2953e21a691d19291'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.873544 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd831c064bc4aa2953e21a691d19291'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.885929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-adb307e2-07d6-4b74-8c97-984411a1375d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd831c064bc4aa2953e21a691d19291'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:28.891814 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1424/2837] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:06:28 2022] DELETE /identity/v3/users/6cd831c064bc4aa2953e21a691d19291 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:29.331946 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:29.333511 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:29.347559 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247f064-8d93-4e52-8895-4dd1e803adc0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:29.404978 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:29.405845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:29.406126 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:29.406392 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] PATH_INFO: `/v3/projects/5aa494a0325140e799a9137d2be22177` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:29.407633 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa494a0325140e799a9137d2be22177)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:29.409997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:29.549647 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa494a0325140e799a9137d2be22177', 'request_id': 'req-546c8ba4-cc56-4658-aa6c-6db626f89d1c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:29.555462 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa494a0325140e799a9137d2be22177', 'request_id': 'req-546c8ba4-cc56-4658-aa6c-6db626f89d1c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:29.679273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa494a0325140e799a9137d2be22177', 'request_id': 'req-546c8ba4-cc56-4658-aa6c-6db626f89d1c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:29.691962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] The token cache is being invalidate because project 5aa494a0325140e799a9137d2be22177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:06:29.691962 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:29.692441 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-546c8ba4-cc56-4658-aa6c-6db626f89d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:29.693959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1414/2838] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:06:29 2022] DELETE /identity/v3/projects/5aa494a0325140e799a9137d2be22177 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:29.700235 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a7dad-b4d8-448c-9bb9-ce2c9b457b81 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:29.700711 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a7dad-b4d8-448c-9bb9-ce2c9b457b81 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:29.700817 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a7dad-b4d8-448c-9bb9-ce2c9b457b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:29.718472 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-b95a7dad-b4d8-448c-9bb9-ce2c9b457b81 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:29.719697 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-b95a7dad-b4d8-448c-9bb9-ce2c9b457b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:29.776948 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1425/2839] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:29.784664 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d51b-aeb0-4d02-a8c9-086a942b994a None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:29.784992 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d51b-aeb0-4d02-a8c9-086a942b994a None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:29.785269 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d51b-aeb0-4d02-a8c9-086a942b994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:29.804411 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-19b0d51b-aeb0-4d02-a8c9-086a942b994a None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:29.805601 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-19b0d51b-aeb0-4d02-a8c9-086a942b994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:29.813742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1415/2840] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:29.818510 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a7dad-b4d8-448c-9bb9-ce2c9b457b81 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:29.828119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a7dad-b4d8-448c-9bb9-ce2c9b457b81 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:29.832905 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:29.833546 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:29.833822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:29.834091 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:29.835002 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:06:29.835308 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:29.836898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:29.848062 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1426/2841] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 10:06:29.852525 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d51b-aeb0-4d02-a8c9-086a942b994a None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:29.862289 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d51b-aeb0-4d02-a8c9-086a942b994a None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:29.867548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:29.868763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:29.868763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:29.868959 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:29.869556 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:29.871486 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:30.012465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1416/2842] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:06:29 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:06:30.016449 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:30.026373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efad316-7118-45ec-962d-5eee64ad0447 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:30.080665 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:30.081336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:30.081625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:30.081893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:30.082602 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:30.084533 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:30.193946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1427/2843] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:06:30 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:06:30.198186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:30.210104 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d46c-2285-419f-b9de-729a87a3a920 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:30.214960 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:30.215645 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:30.215919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:30.216186 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:30.216919 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:30.218543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:30.229343 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1417/2844] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:06:30.233432 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:30.243469 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85fc10-7ace-4194-b57f-1ea68d2ead2f admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:30.248195 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aba19b-b85a-4263-ad34-7ca294713caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:30.248844 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba19b-b85a-4263-ad34-7ca294713caf admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:30.249131 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba19b-b85a-4263-ad34-7ca294713caf admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:30.249409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba19b-b85a-4263-ad34-7ca294713caf admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:30.250141 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aba19b-b85a-4263-ad34-7ca294713caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:30.252016 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aba19b-b85a-4263-ad34-7ca294713caf admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:30.262386 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1428/2845] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 17 10:06:30.266419 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:30.276740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46648bd1-5d33-46e5-9555-01375514f79e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:30.281575 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:30.282450 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:30.282750 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:30.283051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] PATH_INFO: `/v3/projects/4a342df495004eac9ec6bb181ab60871/users/2a929b304a3c47969b3978725a4e9587/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:30.297603 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a342df495004eac9ec6bb181ab60871, user_id=2a929b304a3c47969b3978725a4e9587, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:30.300875 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:30.411807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1418/2846] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:06:30 2022] PUT /identity/v3/projects/4a342df495004eac9ec6bb181ab60871/users/2a929b304a3c47969b3978725a4e9587/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:30.421908 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e315d3-416e-44b0-994f-1d0ed0305190 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:30.422191 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e315d3-416e-44b0-994f-1d0ed0305190 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:30.422466 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e315d3-416e-44b0-994f-1d0ed0305190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:30.448352 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-c7e315d3-416e-44b0-994f-1d0ed0305190 None None] MFA Rules not processed for user `2a929b304a3c47969b3978725a4e9587`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:30.449536 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c7e315d3-416e-44b0-994f-1d0ed0305190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:30.511980 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1429/2847] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 17 10:06:30.522988 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:30.525523 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:30.585740 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f51b32-3063-40c1-8291-bc8363a76e82 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:30.589476 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221fc6-78cd-499f-b65a-3aa265e419c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:30.590114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221fc6-78cd-499f-b65a-3aa265e419c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:30.590394 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221fc6-78cd-499f-b65a-3aa265e419c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:30.590670 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221fc6-78cd-499f-b65a-3aa265e419c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:30.600028 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42221fc6-78cd-499f-b65a-3aa265e419c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:30.601712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42221fc6-78cd-499f-b65a-3aa265e419c5 service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:30.611056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1419/2848] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:06:34.742145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e315d3-416e-44b0-994f-1d0ed0305190 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:34.821392 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e315d3-416e-44b0-994f-1d0ed0305190 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:34.827815 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:34.829414 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:34.829968 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:34.830499 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] PATH_INFO: `/v3/users/2a929b304a3c47969b3978725a4e9587` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:34.832648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a929b304a3c47969b3978725a4e9587)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:34.836767 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:35.063627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a929b304a3c47969b3978725a4e9587'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:35.071431 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a929b304a3c47969b3978725a4e9587'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:35.072115 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a929b304a3c47969b3978725a4e9587'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:35.136097 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a929b304a3c47969b3978725a4e9587'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:35.149475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a929b304a3c47969b3978725a4e9587'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:35.156785 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1430/2849] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:06:34 2022] DELETE /identity/v3/users/2a929b304a3c47969b3978725a4e9587 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 17 10:06:35.161840 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:35.162330 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:35.167196 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:35.179271 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:35.180460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:35.236245 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1420/2850] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:35.245955 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:35.247374 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:35.436692 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1132a-e6d4-4ad7-9b35-1bae59d244eb admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:35.440840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da063b18-4855-4a68-aa8c-842b448c220e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:35.442041 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063b18-4855-4a68-aa8c-842b448c220e service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:35.442319 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063b18-4855-4a68-aa8c-842b448c220e service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:35.442594 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063b18-4855-4a68-aa8c-842b448c220e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:35.452257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da063b18-4855-4a68-aa8c-842b448c220e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:35.453698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da063b18-4855-4a68-aa8c-842b448c220e service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:35.467416 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1431/2851] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:06:35.886259 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:35.887677 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:35.900305 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19a148-1838-4c95-8505-7e482e7dd0ec None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:35.905320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:35.906220 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:35.906502 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:35.906814 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] PATH_INFO: `/v3/projects/4a342df495004eac9ec6bb181ab60871` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:35.908017 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a342df495004eac9ec6bb181ab60871)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:35.909918 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:36.009807 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a342df495004eac9ec6bb181ab60871', 'request_id': 'req-298157cf-c3c5-4bba-8d3b-78925ece777f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:36.015070 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a342df495004eac9ec6bb181ab60871', 'request_id': 'req-298157cf-c3c5-4bba-8d3b-78925ece777f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:36.095545 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a342df495004eac9ec6bb181ab60871', 'request_id': 'req-298157cf-c3c5-4bba-8d3b-78925ece777f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:36.107049 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] The token cache is being invalidate because project 4a342df495004eac9ec6bb181ab60871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:06:36.107335 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:36.107951 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-298157cf-c3c5-4bba-8d3b-78925ece777f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:06:36.109460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1421/2852] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:06:35 2022] DELETE /identity/v3/projects/4a342df495004eac9ec6bb181ab60871 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:36.115148 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368016-bb6a-41df-930b-441c966b6a74 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.115627 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368016-bb6a-41df-930b-441c966b6a74 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.115728 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc368016-bb6a-41df-930b-441c966b6a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.144236 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-dc368016-bb6a-41df-930b-441c966b6a74 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:36.145576 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-dc368016-bb6a-41df-930b-441c966b6a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:36.205413 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1432/2853] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:36.215113 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656dbda-db72-422e-8db5-dd2f81679028 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.215600 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656dbda-db72-422e-8db5-dd2f81679028 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.215728 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656dbda-db72-422e-8db5-dd2f81679028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.234515 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-c656dbda-db72-422e-8db5-dd2f81679028 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:36.235746 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c656dbda-db72-422e-8db5-dd2f81679028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:36.244307 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1422/2854] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:36.248635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368016-bb6a-41df-930b-441c966b6a74 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:36.257992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc368016-bb6a-41df-930b-441c966b6a74 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:36.262479 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:36.263169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.263474 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.263746 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.264552 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:06:36.264856 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:36.266513 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:36.278800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1433/2855] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 17 10:06:36.283102 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656dbda-db72-422e-8db5-dd2f81679028 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:36.292619 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656dbda-db72-422e-8db5-dd2f81679028 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:36.297414 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:36.298055 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.298336 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.298608 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.299338 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:36.301254 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:36.423458 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1423/2856] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:06:36 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:06:36.428137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:36.437822 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd36ba-65a6-4769-8c5c-2b19ad506b51 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:36.492377 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:36.493036 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.493316 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.493586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.494283 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:36.496199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:36.611655 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1434/2857] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:06:36 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:06:36.614982 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:36.625636 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362599fe-7f1a-4b4b-b0a1-1ae2840067a0 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:36.630896 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:36.631550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.631948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.632230 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.632996 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:36.634588 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:36.644899 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1424/2858] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:06:36.648850 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:36.659626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deac450-f141-4347-b486-290373e3e5ad admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:36.664372 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7880a66-6118-45e9-a75a-fd7617462231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:36.665026 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7880a66-6118-45e9-a75a-fd7617462231 admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.665307 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7880a66-6118-45e9-a75a-fd7617462231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.665580 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7880a66-6118-45e9-a75a-fd7617462231 admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.666318 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7880a66-6118-45e9-a75a-fd7617462231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:36.667947 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7880a66-6118-45e9-a75a-fd7617462231 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:36.678840 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1435/2859] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:06:36.682842 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:36.692661 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e071c2b-6f08-49a0-bd07-759955e2fff3 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:36.697325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:36.698180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.698455 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.698746 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] PATH_INFO: `/v3/projects/4263a24c713e41419484fed6a98578f4/users/3c3bf558589c4949a0dfc2827e453a1f/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.712770 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4263a24c713e41419484fed6a98578f4, user_id=3c3bf558589c4949a0dfc2827e453a1f, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:36.715469 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:36.828109 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1425/2860] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:06:36 2022] PUT /identity/v3/projects/4263a24c713e41419484fed6a98578f4/users/3c3bf558589c4949a0dfc2827e453a1f/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:06:36.838591 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:36.838965 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:36.839323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:36.867578 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] MFA Rules not processed for user `3c3bf558589c4949a0dfc2827e453a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:06:36.868779 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:36.931493 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1436/2861] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:06:36.941413 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:36.943162 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:37.000964 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a982ac3-cf6e-44a7-8688-c5d1abdc1323 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:37.004940 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:37.005616 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:37.005927 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:37.006223 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:37.014743 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:37.016243 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:37.025758 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1426/2862] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:06:44.278570 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:44.280114 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:44.378249 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501c603-ad63-4d80-99eb-c991fdc06c83 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:44.383931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:44.384584 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:44.384862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:44.385132 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:44.386938 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:44.398477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:44.400084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:44.410625 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1437/2863] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:06:45.025595 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:06:45.027229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:45.087467 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f9c92-6687-4834-8318-354a37c1d4bc service cinder] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:06:45.091118 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f629409-31e8-49b0-aa2d-4523a10a7ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:06:45.091764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629409-31e8-49b0-aa2d-4523a10a7ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:06:45.092051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629409-31e8-49b0-aa2d-4523a10a7ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:06:45.092323 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629409-31e8-49b0-aa2d-4523a10a7ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:06:45.094112 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-9f629409-31e8-49b0-aa2d-4523a10a7ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:06:45.156260 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629409-31e8-49b0-aa2d-4523a10a7ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:06:45.157696 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629409-31e8-49b0-aa2d-4523a10a7ff1 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:06:45.167855 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1427/2864] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:06:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:07:02.124516 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:02.185162 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d925c-a518-45f3-97fe-bf4f5e9d8068 service placement] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:02.189690 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:02.190548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:02.190862 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:02.191137 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] PATH_INFO: `/v3/users/3c3bf558589c4949a0dfc2827e453a1f` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:02.192427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3bf558589c4949a0dfc2827e453a1f)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:02.194334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:02.446446 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3bf558589c4949a0dfc2827e453a1f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:02.453257 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3bf558589c4949a0dfc2827e453a1f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:02.453917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3bf558589c4949a0dfc2827e453a1f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:02.535834 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3bf558589c4949a0dfc2827e453a1f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:02.548150 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3bf558589c4949a0dfc2827e453a1f'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:02.555067 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1438/2865] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:07:02 2022] DELETE /identity/v3/users/3c3bf558589c4949a0dfc2827e453a1f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:07:02.559589 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:02.560089 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:02.560198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:02.577123 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:07:02.578291 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:02.635766 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1428/2866] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:07:02.652548 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:02.654079 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:02.711366 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e257cf-8082-46a0-8631-d5247ce079b8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:02.714932 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713eff5-6560-41b1-9e98-8dffe7919a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:02.715566 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713eff5-6560-41b1-9e98-8dffe7919a2e service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:02.715851 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713eff5-6560-41b1-9e98-8dffe7919a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:02.716119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713eff5-6560-41b1-9e98-8dffe7919a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:02.725154 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713eff5-6560-41b1-9e98-8dffe7919a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:02.726776 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713eff5-6560-41b1-9e98-8dffe7919a2e service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:02.735537 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1439/2867] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:07:03.193669 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:03.195177 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:03.207501 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ec3d7-ed42-4ad8-a779-ca47aa97a61c None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:03.212156 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:03.213002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:03.213280 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:03.213550 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] PATH_INFO: `/v3/projects/4263a24c713e41419484fed6a98578f4` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:03.214761 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4263a24c713e41419484fed6a98578f4)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:03.216693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:03.361627 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4263a24c713e41419484fed6a98578f4', 'request_id': 'req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:03.368187 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4263a24c713e41419484fed6a98578f4', 'request_id': 'req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:03.455678 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4263a24c713e41419484fed6a98578f4', 'request_id': 'req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:03.467082 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] The token cache is being invalidate because project 4263a24c713e41419484fed6a98578f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:07:03.467368 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:03.467997 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-d7a0a80a-52b1-4de9-b58d-1f96f7d29e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:03.469739 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1429/2868] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:07:03 2022] DELETE /identity/v3/projects/4263a24c713e41419484fed6a98578f4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:07:03.476199 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b8ee-e03a-42e0-b3ee-f4f79e91daaf None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:03.476675 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b8ee-e03a-42e0-b3ee-f4f79e91daaf None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:03.476783 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b8ee-e03a-42e0-b3ee-f4f79e91daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:03.495679 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-da67b8ee-e03a-42e0-b3ee-f4f79e91daaf None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:07:03.496869 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-da67b8ee-e03a-42e0-b3ee-f4f79e91daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:03.553878 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1440/2869] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:07:03.562453 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405231-78da-484f-8b75-069d203903d7 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:03.562999 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405231-78da-484f-8b75-069d203903d7 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:03.563105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405231-78da-484f-8b75-069d203903d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:03.581325 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ac405231-78da-484f-8b75-069d203903d7 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:07:03.582496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ac405231-78da-484f-8b75-069d203903d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:03.590174 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1430/2870] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:07:03.594325 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b8ee-e03a-42e0-b3ee-f4f79e91daaf None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:03.604411 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b8ee-e03a-42e0-b3ee-f4f79e91daaf None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:03.609123 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:03.609838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:03.610119 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:03.610396 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:03.611713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 17 10:07:03.612020 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:03.613642 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:03.624929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1441/2871] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jan 17 10:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 17 10:07:03.629203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac405231-78da-484f-8b75-069d203903d7 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:03.638631 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac405231-78da-484f-8b75-069d203903d7 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:03.643772 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:03.644464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:03.644738 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:03.645007 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:03.645712 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:03.647653 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:03.794609 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1431/2872] 10.222.0.88 () {60 vars in 1152 bytes} [Mon Jan 17 10:07:03 2022] POST /identity/v3/projects => generated 399 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 17 10:07:03.799491 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:03.809169 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f032ec4-51be-42e6-a170-c377c6b2bc4d admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:03.863299 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:03.864044 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:03.864243 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:03.864515 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:03.865223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:03.867134 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:03.982303 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1442/2873] 10.222.0.88 () {60 vars in 1143 bytes} [Mon Jan 17 10:07:03 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 17 10:07:03.987351 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:03.997845 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf731c-8e55-426e-83fc-3f1489755f58 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:04.004371 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:04.005033 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:04.005749 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:04.006032 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:04.006936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:04.009755 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:04.022179 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1432/2874] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:07:04.029917 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:04.040409 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5868ca9-836d-450e-a79f-553d41241dd0 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:04.045209 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f4fbb-97e5-4d43-86ec-ea2e673c2b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:04.045809 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f4fbb-97e5-4d43-86ec-ea2e673c2b7d admin admin] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:04.046089 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f4fbb-97e5-4d43-86ec-ea2e673c2b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:04.046363 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f4fbb-97e5-4d43-86ec-ea2e673c2b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:04.047138 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f4fbb-97e5-4d43-86ec-ea2e673c2b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:04.048749 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f4fbb-97e5-4d43-86ec-ea2e673c2b7d admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:04.058475 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1443/2875] 10.222.0.88 () {58 vars in 1121 bytes} [Mon Jan 17 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 17 10:07:04.062783 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:04.073105 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86190def-6353-4118-879a-8997cde79b8c admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:04.077808 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:04.078689 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:04.079002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:04.079273 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] PATH_INFO: `/v3/projects/23c7a73b570b4bdfad3e5c7139d7a480/users/6d977120f34c420d8e7128c3f6d04c4c/roles/195819215583470b80fa053d7de42a6c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:04.094198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c7a73b570b4bdfad3e5c7139d7a480, user_id=6d977120f34c420d8e7128c3f6d04c4c, role_id=195819215583470b80fa053d7de42a6c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:04.097532 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:04.193520 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1433/2876] 10.222.0.88 () {60 vars in 1482 bytes} [Mon Jan 17 10:07:04 2022] PUT /identity/v3/projects/23c7a73b570b4bdfad3e5c7139d7a480/users/6d977120f34c420d8e7128c3f6d04c4c/roles/195819215583470b80fa053d7de42a6c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:07:04.204314 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd881a-3ad5-4ef7-8df5-8791cf7677c4 None None] REQUEST_METHOD: `POST` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:04.204605 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd881a-3ad5-4ef7-8df5-8791cf7677c4 None None] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:04.204885 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd881a-3ad5-4ef7-8df5-8791cf7677c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:04.231924 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.auth.core [None req-fccd881a-3ad5-4ef7-8df5-8791cf7677c4 None None] MFA Rules not processed for user `6d977120f34c420d8e7128c3f6d04c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:07:04.233118 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-fccd881a-3ad5-4ef7-8df5-8791cf7677c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:04.295163 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1444/2877] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:07:04.305213 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:04.306931 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:04.389256 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ce840-6550-4bea-8ba6-c201d3fab3c8 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:04.393764 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8f8b-57c5-4216-8e01-2e7a5112d96f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:04.394405 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8f8b-57c5-4216-8e01-2e7a5112d96f service cinder] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:04.394681 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8f8b-57c5-4216-8e01-2e7a5112d96f service cinder] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:04.394984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8f8b-57c5-4216-8e01-2e7a5112d96f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:04.403781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8f8b-57c5-4216-8e01-2e7a5112d96f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:04.405209 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8f8b-57c5-4216-8e01-2e7a5112d96f service cinder] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:04.413961 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1434/2878] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:07:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:07:14.880456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd881a-3ad5-4ef7-8df5-8791cf7677c4 None None] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:14.941606 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd881a-3ad5-4ef7-8df5-8791cf7677c4 None None] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:14.946214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:14.947100 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:14.947380 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:14.947651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] PATH_INFO: `/v3/users/6d977120f34c420d8e7128c3f6d04c4c` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:14.948838 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d977120f34c420d8e7128c3f6d04c4c)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:14.950752 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:15.195008 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d977120f34c420d8e7128c3f6d04c4c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:15.201786 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d977120f34c420d8e7128c3f6d04c4c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:15.202456 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d977120f34c420d8e7128c3f6d04c4c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:15.301295 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d977120f34c420d8e7128c3f6d04c4c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:15.314952 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d977120f34c420d8e7128c3f6d04c4c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:15.321529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1445/2879] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:07:14 2022] DELETE /identity/v3/users/6d977120f34c420d8e7128c3f6d04c4c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:07:15.326317 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:15.326886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:15.326886 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:15.349948 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] MFA Rules not processed for user `caa8734036c04822b77766dda26302e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:07:15.351194 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:15.411018 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1435/2880] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:07:15.421484 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:15.423882 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:15.488421 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ece667-ea48-4bd7-ab30-3370f6e8b7c5 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:15.492024 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:15.492687 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:15.492969 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:15.493245 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:15.506810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:15.508732 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:15.519105 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1446/2881] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:07:16.034834 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:16.036356 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:16.051350 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a269187-3987-4dae-8271-ce3105e97470 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:16.056534 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:16.057496 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:16.057787 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:16.059614 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] PATH_INFO: `/v3/projects/23c7a73b570b4bdfad3e5c7139d7a480` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:16.060936 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c7a73b570b4bdfad3e5c7139d7a480)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:16.062921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:16.197835 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c7a73b570b4bdfad3e5c7139d7a480', 'request_id': 'req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:16.203095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c7a73b570b4bdfad3e5c7139d7a480', 'request_id': 'req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:16.301801 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c7a73b570b4bdfad3e5c7139d7a480', 'request_id': 'req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:16.313580 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] The token cache is being invalidate because project 23c7a73b570b4bdfad3e5c7139d7a480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:07:16.314437 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:16.315095 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-92a4cd7c-d94b-47d0-947e-b9e822ff0b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:07:16.316630 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1436/2882] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:07:16 2022] DELETE /identity/v3/projects/23c7a73b570b4bdfad3e5c7139d7a480 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:07:47.483159 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:07:47.484695 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:47.544557 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbc4e6-0b0b-4281-958c-e81415d9132f service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:07:47.593156 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6c69b3efe444c5893683fa61dc9dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:07:47.593829 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:47.594112 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:47.594381 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:47.596237 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:47.657614 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:07:47.659086 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:07:47.669745 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1447/2883] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:07:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:07:59.602432 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] REQUEST_METHOD: `POST` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:07:59.603056 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:07:59.603180 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:07:59.622857 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.auth.core [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] MFA Rules not processed for user `4a5e9ce41413483d86df40bbb8b7a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 17 10:07:59.624002 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:07:59.631693 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1437/2884] 10.222.0.88 () {58 vars in 957 bytes} [Mon Jan 17 10:07:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 17 10:08:18.634439 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:08:18.636046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:08:18.698477 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec7110-8dea-4902-896d-d30f18d8cdbf service cinder] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:08:18.703964 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:08:18.704609 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:08:18.704887 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:08:18.705157 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:08:18.707103 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:08:18.772175 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:08:18.773607 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:08:18.784084 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1448/2885] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:08:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:09:05.083483 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:09:05.084829 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:09:05.097943 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cae3d-01e6-4e94-933a-1596773d53e4 None None] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:09:05.101572 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:09:05.102208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:09:05.102491 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:09:05.102791 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:09:05.104584 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:09:05.195266 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:09:05.196721 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:09:05.218563 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1438/2886] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:09:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:09:06.397323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:09:06.406539 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3a7d2-9105-42d4-b009-ed2a1aa6207a service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:09:06.410258 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:09:06.410929 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:09:06.411214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:09:06.411485 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:09:06.413247 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:09:06.427522 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:09:06.428985 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:09:06.440870 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1449/2887] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:09:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:09:15.344727 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:09:15.354148 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6172c-7666-442e-a567-70be6c9a7beb service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:09:15.359161 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:09:15.359818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:09:15.360098 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:09:15.360377 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:09:15.362155 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:09:15.372638 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:09:15.374208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:09:15.383276 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1439/2888] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:09:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 17 10:09:19.908626 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:09:19.917684 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baa6e1-a51b-4825-972d-c8c2e9994648 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:09:19.921944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:09:19.922585 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:09:19.922898 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:09:19.923165 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:09:19.924884 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:09:19.935323 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:09:19.937899 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:09:19.945252 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1450/2889] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:09:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:10:24.053228 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:10:24.054763 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:10:24.071639 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60adfec-7728-42f1-b211-1ca7996afc56 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:10:24.078316 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4b284f0c1348bb9baa47b4c531821e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:10:24.079108 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:10:24.079521 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:10:24.079800 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:10:24.081680 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:10:24.095428 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:10:24.097008 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:10:24.109826 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1440/2890] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:10:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:10:41.027093 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:10:41.035946 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb258da-2097-47d3-b199-4e701f048e17 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:10:41.039673 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:10:41.040336 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:10:41.040620 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:10:41.040893 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:10:41.042648 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:10:41.106492 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:10:41.107957 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:10:41.117427 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1451/2891] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:10:49.404957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:10:49.404957 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:10:49.418620 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d7eb-e647-4df9-b180-94a2b3db31c6 service nova] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:10:49.423270 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:10:49.424182 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:10:49.424464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:10:49.424741 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] PATH_INFO: `/v3/users/4a5e9ce41413483d86df40bbb8b7a0ad` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:10:49.425944 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5e9ce41413483d86df40bbb8b7a0ad)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:10:49.427955 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:10:49.718160 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5e9ce41413483d86df40bbb8b7a0ad'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:49.725015 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5e9ce41413483d86df40bbb8b7a0ad'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:49.800788 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5e9ce41413483d86df40bbb8b7a0ad'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:49.801443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5e9ce41413483d86df40bbb8b7a0ad'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:49.819203 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5e9ce41413483d86df40bbb8b7a0ad'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:49.825198 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1441/2892] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:10:49 2022] DELETE /identity/v3/users/4a5e9ce41413483d86df40bbb8b7a0ad => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:10:50.100535 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:10:50.113586 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43742a7-b644-45b3-b1eb-8c892eb87d7f service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:10:50.172145 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:10:50.172992 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:10:50.173269 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:10:50.173538 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] PATH_INFO: `/v3/projects/d877f04e846b491fbdf9e75655bacd33` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:10:50.174744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d877f04e846b491fbdf9e75655bacd33)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:10:50.176699 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:10:50.310278 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd877f04e846b491fbdf9e75655bacd33', 'request_id': 'req-5af5bdad-fa5e-46e3-b615-49f42338d823'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:50.315663 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd877f04e846b491fbdf9e75655bacd33', 'request_id': 'req-5af5bdad-fa5e-46e3-b615-49f42338d823'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:50.406676 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd877f04e846b491fbdf9e75655bacd33', 'request_id': 'req-5af5bdad-fa5e-46e3-b615-49f42338d823'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:50.418223 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] The token cache is being invalidate because project d877f04e846b491fbdf9e75655bacd33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:10:50.418529 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:50.419197 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:50.420714 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1452/2893] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:10:50 2022] DELETE /identity/v3/projects/d877f04e846b491fbdf9e75655bacd33 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:10:50.424794 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:10:50.426320 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:10:50.440286 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f359ca3-9354-4ef6-a8e2-109f41dfc4f9 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:10:50.497107 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:10:50.497984 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:10:50.498267 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:10:50.498543 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] PATH_INFO: `/v3/users/e87c5f1b95c240cd85862539ba7adb64` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:10:50.499803 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87c5f1b95c240cd85862539ba7adb64)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:10:50.501742 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:10:50.920782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87c5f1b95c240cd85862539ba7adb64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:50.927582 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87c5f1b95c240cd85862539ba7adb64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:51.092294 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87c5f1b95c240cd85862539ba7adb64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:51.093128 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87c5f1b95c240cd85862539ba7adb64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:51.106851 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87c5f1b95c240cd85862539ba7adb64'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:51.113048 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1442/2894] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:10:50 2022] DELETE /identity/v3/users/e87c5f1b95c240cd85862539ba7adb64 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:10:51.368879 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:10:51.370334 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:10:51.385762 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5bdad-fa5e-46e3-b615-49f42338d823 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:10:51.448031 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:10:51.449046 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:10:51.449330 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:10:51.449601 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] PATH_INFO: `/v3/projects/1fdd2c3f37b54141b0f1549c0c996719` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:10:51.450953 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdd2c3f37b54141b0f1549c0c996719)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:10:51.452944 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:10:51.898051 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdd2c3f37b54141b0f1549c0c996719', 'request_id': 'req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:51.903369 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdd2c3f37b54141b0f1549c0c996719', 'request_id': 'req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:52.022857 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdd2c3f37b54141b0f1549c0c996719', 'request_id': 'req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:52.035458 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] The token cache is being invalidate because project 1fdd2c3f37b54141b0f1549c0c996719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:10:52.035768 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:52.036418 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:10:52.037931 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1453/2895] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:10:51 2022] DELETE /identity/v3/projects/1fdd2c3f37b54141b0f1549c0c996719 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:11:12.674167 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:11:12.675625 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:11:12.731818 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906334a-5843-434a-a47b-1558cb5515a2 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:11:12.778208 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:11:12.778885 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:11:12.779163 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:11:12.779464 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:11:12.781216 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:11:12.839921 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:11:12.842782 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:11:12.852278 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1443/2896] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:11:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:11:19.393590 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:11:19.395059 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:11:19.408049 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfa2a3-f6a6-4e8d-bc9d-fc25d676a4a8 admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:11:19.411652 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc44cadca4c4ac3a3264de0a4641437', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:11:19.416407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] REQUEST_METHOD: `GET` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:11:19.416407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:11:19.416407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:11:19.416407 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:11:19.478158 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:11:19.479551 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:11:19.489393 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1454/2897] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 17 10:11:27.999793 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:11:28.001218 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:11:28.016924 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd000-b03b-4c81-9ae1-497ed4a0bfb9 service neutron] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:11:28.021571 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:11:28.022443 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:11:28.022773 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:11:28.023034 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] PATH_INFO: `/v3/users/14db3e2d0d2c43e883e64287c9daf15c` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:11:28.024227 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14db3e2d0d2c43e883e64287c9daf15c)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:11:28.026134 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:11:28.412460 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14db3e2d0d2c43e883e64287c9daf15c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:28.419654 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14db3e2d0d2c43e883e64287c9daf15c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:28.491060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14db3e2d0d2c43e883e64287c9daf15c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:28.491744 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14db3e2d0d2c43e883e64287c9daf15c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:28.504051 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14db3e2d0d2c43e883e64287c9daf15c'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:28.509894 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1444/2898] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:11:27 2022] DELETE /identity/v3/users/14db3e2d0d2c43e883e64287c9daf15c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:11:28.836089 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:11:28.846751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e457dd-5c0a-4b1e-a35b-30377ecdbcc8 service neutron] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:11:28.904344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:11:28.904344 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:11:28.904698 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:11:28.904821 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] PATH_INFO: `/v3/projects/abba12a7c8bf4381b4ca8742e8354cc7` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:11:28.905993 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] RBAC: Authorizing `identity:delete_project(project_id=abba12a7c8bf4381b4ca8742e8354cc7)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:11:28.907904 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:11:29.028617 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abba12a7c8bf4381b4ca8742e8354cc7', 'request_id': 'req-c507e238-752d-4640-bd3d-c8b602df920c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.034401 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abba12a7c8bf4381b4ca8742e8354cc7', 'request_id': 'req-c507e238-752d-4640-bd3d-c8b602df920c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.161735 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abba12a7c8bf4381b4ca8742e8354cc7', 'request_id': 'req-c507e238-752d-4640-bd3d-c8b602df920c'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.172635 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] The token cache is being invalidate because project abba12a7c8bf4381b4ca8742e8354cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:11:29.172918 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.173559 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.175116 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1455/2899] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:11:28 2022] DELETE /identity/v3/projects/abba12a7c8bf4381b4ca8742e8354cc7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:11:29.179822 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:11:29.181357 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:11:29.194717 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7fc66-dc9a-46d5-bb6d-80fd6ee9069e admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:11:29.250889 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:11:29.251785 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:11:29.252063 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:11:29.252333 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] PATH_INFO: `/v3/users/7324f0ad5f3843579a481169ae37170f` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:11:29.253524 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7324f0ad5f3843579a481169ae37170f)` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:11:29.255465 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:11:29.516221 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7324f0ad5f3843579a481169ae37170f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.523472 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7324f0ad5f3843579a481169ae37170f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.651537 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7324f0ad5f3843579a481169ae37170f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.652222 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7324f0ad5f3843579a481169ae37170f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.665117 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.notifications [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7324f0ad5f3843579a481169ae37170f'} {{(pid=91335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:29.671136 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1445/2900] 10.222.0.88 () {58 vars in 1223 bytes} [Mon Jan 17 10:11:29 2022] DELETE /identity/v3/users/7324f0ad5f3843579a481169ae37170f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:11:29.968239 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Authenticating user token {{(pid=91336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:11:29.973494 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.fernet_utils [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:11:29.985214 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507e238-752d-4640-bd3d-c8b602df920c admin admin] Validating token access rules against request {{(pid=91336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:11:30.052713 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8734036c04822b77766dda26302e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fc0e2d15dd458c8be52038432f65bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:11:30.054810 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:11:30.055096 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:11:30.055373 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] PATH_INFO: `/v3/projects/2db1264c7b224369bc8d357621c6c3e5` {{(pid=91336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:11:30.056751 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db1264c7b224369bc8d357621c6c3e5)` {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:11:30.058792 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] RBAC: Authorization granted {{(pid=91336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:11:30.218800 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db1264c7b224369bc8d357621c6c3e5', 'request_id': 'req-29412868-1962-4ac4-8352-fe4781108148'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:30.224744 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db1264c7b224369bc8d357621c6c3e5', 'request_id': 'req-29412868-1962-4ac4-8352-fe4781108148'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:30.319926 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db1264c7b224369bc8d357621c6c3e5', 'request_id': 'req-29412868-1962-4ac4-8352-fe4781108148'} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:30.332901 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] The token cache is being invalidate because project 2db1264c7b224369bc8d357621c6c3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 17 10:11:30.334651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:30.334651 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: DEBUG keystone.notifications [None req-29412868-1962-4ac4-8352-fe4781108148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 17 10:11:30.336547 dv-cinder-824839-2-iscsi devstack@keystone.service[91336]: [pid: 91336|app: 0|req: 1456/2901] 10.222.0.88 () {58 vars in 1232 bytes} [Mon Jan 17 10:11:29 2022] DELETE /identity/v3/projects/2db1264c7b224369bc8d357621c6c3e5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 17 10:12:45.783836 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Authenticating user token {{(pid=91335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 17 10:12:45.785229 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:12:45.856114 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229b989-c6e4-4ae4-9be3-9d618dacea26 admin admin] Validating token access rules against request {{(pid=91335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 17 10:12:45.917815 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc2ec0-76f6-4b8f-8319-59ad1da89db8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd2d1e8d054688a294bcc718449005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2614964b1c94d9c872f79fedd7d7dbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 17 10:12:45.918471 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2ec0-76f6-4b8f-8319-59ad1da89db8 service placement] REQUEST_METHOD: `GET` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 17 10:12:45.918781 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2ec0-76f6-4b8f-8319-59ad1da89db8 service placement] SCRIPT_NAME: `/identity` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 17 10:12:45.919060 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc2ec0-76f6-4b8f-8319-59ad1da89db8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 17 10:12:45.920933 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.fernet_utils [None req-1afc2ec0-76f6-4b8f-8319-59ad1da89db8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 17 10:12:45.932949 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc2ec0-76f6-4b8f-8319-59ad1da89db8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 17 10:12:45.934548 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc2ec0-76f6-4b8f-8319-59ad1da89db8 service placement] RBAC: Authorization granted {{(pid=91335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 17 10:12:45.944752 dv-cinder-824839-2-iscsi devstack@keystone.service[91335]: [pid: 91335|app: 0|req: 1446/2902] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Jan 17 10:12:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)